Small but time-aware!
At the " #LLM for for the History, Philosophy, and Sociology of Science workshop" @tuberlin Jochen Büttner presented a compact small language model (39M parameters) that integrates a temporal dimension for historical text analysis.
A proof of concept using historical UK weather reports shows the model successfully reflects both seasonal patterns and linguistic shifts
Wanna try it? 
github.com/j-buettner/time_transformer
[Перевод] «Я ненавижу C++, но восхищаюсь его мастерами»: Дженсен Хуанг (Nvidia) о том, как ИИ вернулся домой
Nvidia давно вышла за пределы игровых миров — сегодня её технологии формируют будущее ИИ, научных исследований, связи и многого другого. Но как компания, начавшая с графики, стала флагманом искусственного интеллекта? В интервью для Computerphile (25.03.2025) Хуанг рассказывает, как закон Амдала уживается с тензорными ядрами, а CUDA из инструмента разработчика превратилась в основу для преобразования индустрий. Это интервью о процессе, в котором технологии развиваются, пересекаются и возвращаются туда, с чего начинали.
Jeremy Howard taught AI and helped invent ChatGPT. He fears he's failed
https://www.abc.net.au/news/science/2023-11-15/jeremy-howard-taught-ai-to-the-world-and-helped-invent-chatgpt/103092474
#ycombinator #artificial_intelligence #jeremy_howard #GPT #ULMFiT #transformer #natural_language_processing #NLP
A #short look at an older #Transformer, Transformers Tribute Evolution Orion Pax was both a neat E-Hobby nod and a really solid robot using the Titan's Return Play Pattern!
Going through old camera roll, what what this #Transformer? A Knock Off Yellow Devastator!? It looks hella cool, where did it go, what happened to you KO Yellow Devy!?
Пишем свой Transformer
Чтобы поупражняться я решила более детально разобраться и попробовать самостоятельно написать Transformer на PyTorch. Результатом захотелось поделиться здесь. Надеюсь, так же как и мне, это поможет доразобраться в данной архитектуре и ответить на какие-то вопросы.
**Evolutionary #Transformer Architecture**
Let me emphasise this;
EVOLUTIONARY TRASFORMER ARCHITECTURE
Self-attention mechanisms to identify functional relationships between genetic sequences
(Note: This is already something #AI does trivially)
Uses massive datasets of existing genomes to learn biological patterns
(Hello human genome databases you probably sent a sample to voluntarily to fin out your ancestry /jk)
Can generate novel gene combinations while maintaining viability
4/6
MoE can drastically reduce computation without sacrificing quality much. #transformer #AI
@seb1959 @Inekeduzz
Één van mijn favoriete liedjes, ook de muziek erbij is prachtig. Trouwens het hele album "Transformer" waar "Perfect Day" op staat is best wel perfect eigenlijk.
Go-attention: A full attention mechanism and transformer in pure Go — https://github.com/takara-ai/go-attention
#HackerNews #GoAttention #GoLang #Transformer #AttentionMechanism #AIDevelopment
Anybody knows where I can find an equivalent transformer? It is for US power, so 110 or 120v in and out it is potentially 7 or 8V and 16 watts or so. Don't have shop manual to confirm but perhaps somebody has a xref shop manual...
Many good tracks on this one, and I took some creative liberties with the recoloured versions. Drawn using Affinity Designer as per usual.
Unlocking the Power of RASP: Introducing Tracr, the Transformer Compiler
Tracr, a cutting-edge compiler developed by DeepMind, transforms RASP programs into efficient transformer weights, bridging the gap between programming and machine learning. This innovative tool not o...
https://news.lavx.hu/article/unlocking-the-power-of-rasp-introducing-tracr-the-transformer-compiler
Hackaday Links: January 26, 2025 - Disappointing news this week for those longing for same-hour Amazon delivery as th... - https://hackaday.com/2025/01/26/hackaday-links-january-26-2025/ #hackadaycolumns #hackadaylinks #bioelectric #transformer #substation #prtection #keyboard #mushroom #pipeline #primeair #undersea #bucholz #slider #amazon #dupont #cable #crimp #drone #plant #uav #usv
@wchr Wow! Thanks for sharing this!
I just read about the #transformer used by the #llm #ai here: https://ig.ft.com/generative-ai/
This article makes the technical stuff so much easier to understand.
Hacker News 
![[CVPR 2025] VGGT: Visual Geometry Grounded Transformer - facebookresearch/vggt](https://s3.c.im/cache/preview_cards/images/038/497/428/original/465eab029613d3cc.png "[CVPR 2025] VGGT: Visual Geometry Grounded Transformer - facebookresearch/vggt")
█▓▒░
