🚀 LLM Inference Deep Dive: Metrics, Batching & GPU Optimization

llm
papers
performance
Technical exploration of LLM inference metrics, batching strategies, and GPU optimization with TensorRT-LLM - from latency metrics to in-flight batching
Dec 9, 2024
muhtasham

🎷 NeurIPS 2023: Trends, Talks, and Technologies

llm
deep-learning
conference
I don’t think the above quote applies to me, but nevertheless wanted to share my first NeurIPS experience. To start with it was an exhilarating whirlwind, packed with a…
Dec 17, 2023
muhtasham

🔥 The Future of AI is Modular: Insights from ModCon 2023

llm
deep-learning
conference
Today, the landscape of AI development is on the brink of a transformative change. I had the opportunity to witness this first-hand at the ModCon conference in San…
Dec 4, 2023
muhtasham

👾 Watermark Security in Language Models

llm
papers
security
tokenizer
In this brief exploration, I delve into a groundbreaking concept: a unique watermarking technique for large language models (LLMs), as detailed in A Watermark for Large…
Nov 20, 2023
muhtasham

2️⃣ Concepts from Operating Systems That Found Their Way in LLMs

llm
papers
security
tokenizer
Diving into the intricacies of technology often uncovers unexpected parallels. Recently, I’ve been struck by how foundational computer operating system concepts are making…
Oct 22, 2023
muhtasham

🖥️​ LLMs for Compiler Optimization: A Deep Dive

llm
papers
The application of Large Language Models (LLMs) in optimizing LLVM assembly for code size is emerging, but is it truly shaping a new reality or just a theoretical…
Sep 19, 2023
muhtasham

📈 Exploring Ways to Extend Context Length in Transformers

llm
papers
Diving deep into the intricacies of large language models (LLMs), one hurdle quickly becomes evident: the context length limitation. While many recognize its implications…
Aug 7, 2023
muhtasham

🚀 Reflections from an Evening with NVIDIA’s Jensen Huang

llm
deep-learning
Listening to a fireside chat with Jensen Huang, the dynamic Founder and CEO of NVIDIA, alongside three pioneering startup founders— Dr. Jaroslaw “Jarek” Kutylowski of DeepL…
Jul 4, 2023
muhtasham

🔮 Navigating the AI Landscape: My Takeaways from Sam Altman’s Discussion

llm
At a recent event at my alma mater, TU Munich featuring Sam Altman, CEO of OpenAI, attendees had the opportunity to delve into a range of topics. From AI regulation, the…
May 27, 2023
muhtasham

💫 StarCoder: A Revolutionary Code Generation Model

llm
papers
Are you tired of spending hours writing repetitive code? Do you find yourself searching through documentation and Stack Overflow for code snippets? Look no further!…
May 22, 2023
muhtasham

🌉 A Deep Dive into the LLM Bootcamp Experience: Revolutionizing AI-Powered Applications

llm
deep-learning
The world of technology is currently undergoing a monumental transformation, and my participation in the LLM Bootcamp was nothing short of enlightening from my perspective.…
Apr 26, 2023
muhtasham

🌁 Mastering the Art of Building a Defensible Business: Insights from a Discussion Panel

venture-captial
The landscape of artificial intelligence (AI) startups is rapidly evolving, and so are the strategies for building a successful and defensible business. A recent discussion…
Apr 26, 2023
muhtasham

🗽 A Philosophical Dive into Deep Learning: My Experience at the NYU Conference

conference
Last week, I was fortunate enough to attend the captivating Philosophy of Deep Learning Conference at New York University. This event united experts from diverse fields to…
Mar 28, 2023
muhtasham

🖼️ Exploring the Latest Advancements in Transfer Learning: A Summary of ICLR’23 Transfer Learning-Related Papers

papers
iclr
transfer-learning
The International Conference on Learning Representations (ICLR) is one of the top conferences in the field of machine learning, and this year’s conference (ICLR 23) features…
Jan 23, 2023
muhtasham

⏳ From Alps to NLP: A 2022 Recap of Exploration and Growth

reflections
goals
As I look back on the year 2022, I can’t help but feel a sense of nostalgia and wonder.
Dec 26, 2022
muhtasham

🤗 Herzlich Wilkommen!

news
Welcome to my new blog and my new home on the internet!
Dec 25, 2022
muhtasham
No matching items