Skip to main content

Going Deeper into AI: The Guts of ChatCPT and Large Language Models – Nerding Out ep39

By AI

What happens inside ChatGPT and other LLMs?

In this episode, we take some time to look under the hood of how a Large Language Model (LLM) like ChatCPT works. Building off of the previous episode where we looked at neural networks, the basis for all AI, we explore how these neural networks are used to comb through large quantities of text, find its meaning, and respond with language that is easy to understand.

We move beyond simple neural networks to discuss the intricacies of Transformer Architecture and Retrieval-Augmented Generation (RAG) and how this approach is central to understanding modern artificial intelligence and machine learning applications.

We also touch on the benefits of running your own local AI model and agent and how we use Ollama at That Nerdy Catholic to help with some of our tasks. You want to know how LLM actually works? Continue this exploration of AI with us.

Links from Episode:

Attention is all you need: https://arxiv.org/pdf/1706.03762

We want your input for this series, so head over to https://thatnerdycatholic.com/ai to share your thoughts and experiences.

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

The Technology Behind ChatGPT: Neural Networks and the AI Revolution – Nerding Out ep38

By AI
Subscribe on YouTube

What is AI, and how does it actually work?

Artificial Intelligence has exploded in popularity with tools like ChatGPT, but the technology behind it has been developing for decades. In this episode, Seth and Cesar break down Artificial Intelligence for beginners, explaining where AI came from, how it evolved, and why it suddenly became so powerful in recent years.

Starting with the early ideas of AI in the 1950s, they trace the key breakthroughs that led to today’s revolution in machine learning and large language models (LLMs). One turning point was the groundbreaking 2017 research paper “Attention Is All You Need,” developed by Google researchers, which introduced the transformer architecture that powers many modern AI systems.

In Part 1 of this two-episode series, they focus on the core building block of modern AI: neural networks.

  • What is a neural network?
  • How do artificial neural networks compare to the neurons in the human brain?
  • How do machines actually learn from data?
  • What’s the difference between supervised learning and unsupervised learning?

If you’ve ever wondered how ChatGPT works, how machines learn patterns, or why AI suddenly seems everywhere, this episode will give you a clear foundation without requiring advanced math.

For viewers who want to dive deeper into the mathematics behind neural networks, Seth and Cesar also reference the excellent visual explanations from the YouTube series by Grant Sanderson on the channel 3Blue1Brown.

If you’re curious about Artificial Intelligence, neural networks, machine learning, and how modern AI models are trained, this video is the perfect place to start.

We want your input for this series, so head over to https://thatnerdycatholic.com/ai to share your thoughts and experiences.

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

AI and Us: A Future in Question. can We Stop AI if we need to? – Nerding Out ep37

By AI
Subscribe on YouTube

With AI already embedded in our daily lives, it’s important that we have a critical conversation about its impact. AI has been touted as a game-changer for humanity, but what does it truly mean for us? What are the ethical issues surrounding AI? What does it mean for AI to reason, to decide, and to have conversations? Can AI take over the world and bring about a utopia or a dystopia? Will AI liberate us or enslave us? What is the role of the AI vs the role of the companies behind it?

From the loss of human agency to the rise of job displacement, the stakes are high. In this series, we’ll explore the philosophical, social, and economic implications of AI. We’ll examine the parallels between the Industrial Revolution of the 19th century and our current technological revolution, and discuss what it means for humanity to take control of AI rather than be controlled by it.

Join us as we venture into the world of AI and examine its implications on society, economy, and individual freedoms.

We want your input for this series, so head over to https://thatnerdycatholic.com/ai to share your thoughts and experiences.

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

What Happens When Machines Do Everything? – Nerding Out ep36

By AI
Subscribe on YouTube

What kind of future can we expect with the rise of AI? Seth and Cesar are beginning a series on AI. They will discuss whether artificial intelligence will help us live a better life so we can pursue the deeper meanings of life and what kind of AI dangers  we need to consider.

Join us as we ask the big questions and prepare to dive deep into some of the answers in the upcoming weeks. Will machines allow us to focus on art, music, and philosophy, or will other factors come into play? What language do we use to describe AI? What happens when we start to treat AI as a person? We want your input for this series, so head over to https://thatnerdycatholic.com/ai to share your thoughts and experiences.

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

Newton’s Physics and God: The Story Behind the Science – Nerding Out ep35

By Uncategorized
Subscribe on YouTube

We often think of scientists as people who are all about logic and reason, but what’s fascinating is that many of them have actually had a deep faith in their lives. Scientists like Newton, Kepler, and Halley were trying to understand the natural world through science, while also believing in a higher power. Newton even said that seeing the universe as just a machine was missing the point – there must be a creator behind it all! But then came the scientific breakthroughs of the 19th century, and suddenly people started thinking they’d figured out everything through science. This way of thinking became so ingrained that many people began to see faith as something old-fashioned and unnecessary. But what if I told you that’s not necessarily the case? There are still scientists today who believe in a higher power, and who think that science and faith aren’t mutually exclusive. It’s time to rethink our assumptions about the natural world and our place within it – there’s so much more to explore! So, let’s keep the conversation going and see where it takes us!

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

Did People Really Think Earth Was the Center of Everything? – The Copernicus Revolution – Nerding Out ep34

By Uncategorized
Subscribe on YouTube

Imagine being able to look through the eyes of history’s most groundbreaking thinkers, and witnessing firsthand the pivotal moments that shaped our understanding of the universe. In this fascinating conversation, hosts Seth and Cesar take you on a journey through the forgotten chapters of scientific discovery, exploring the lives and ideas of visionaries who dared to challenge conventional wisdom.

In this episode they focus on Roger Bacon, the medieval polymath who pioneered the scientific method who will captivate and inspire you. Join Seth and Cesar as they delve into the fascinating stories behind some of science’s most significant breakthroughs, and discover how the pursuit of knowledge has shaped human history.

As a Franciscan Friar, what was life like for Roger Bacon? Getting help from Pope Clement IV, Bacon was able to work on his scientific experiments and writing while staying true to his Franciscan vows. Seth and Cesar look into his most important writings as well as his role in the development of the scientific method. Bacon is an important figure in the history of science that many people don’t know about.

So why wait? Join Seth and Cesar on an unforgettable adventure through the history of physics, and discover how the greatest minds in science continue to inspire us today. By exploring the triumphs and setbacks of these pioneers, you’ll gain a deeper understanding of the scientific method, and develop a newfound respect for the people who have shaped our understanding of the cosmos. So sit back, relax, and get ready to embark on an unforgettable journey through the history of physics!

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

Bacon’s Breakthrough: How a Medieval Mind Changed the Face of Science! – Nerding Out ep33

By Uncategorized
Subscribe on YouTube

Imagine being able to look through the eyes of history’s most groundbreaking thinkers, and witnessing firsthand the pivotal moments that shaped our understanding of the universe. In this fascinating conversation, hosts Seth and Cesar take you on a journey through the forgotten chapters of scientific discovery, exploring the lives and ideas of visionaries who dared to challenge conventional wisdom.

In this episode they focus on Roger Bacon, the medieval polymath who pioneered the scientific method who will captivate and inspire you. Join Seth and Cesar as they delve into the fascinating stories behind some of science’s most significant breakthroughs, and discover how the pursuit of knowledge has shaped human history.

As a Franciscan Friar, what was life like for Roger Bacon? Getting help from Pope Clement IV, Bacon was able to work on his scientific experiments and writing while staying true to his Franciscan vows. Seth and Cesar look into his most important writings as well as his role in the development of the scientific method. Bacon is an important figure in the history of science that many people don’t know about.

So why wait? Join Seth and Cesar on an unforgettable adventure through the history of physics, and discover how the greatest minds in science continue to inspire us today. By exploring the triumphs and setbacks of these pioneers, you’ll gain a deeper understanding of the scientific method, and develop a newfound respect for the people who have shaped our understanding of the cosmos. So sit back, relax, and get ready to embark on an unforgettable journey through the history of physics!

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

How Did Ptolemy Explain Planets Moving Backwards? – Nerding Out ep32

By Uncategorized
Subscribe on YouTube

Join us on this episode of “Nerding Out” as we delve into the fascinating life and work of Ptolemy, an ancient Greek mathematician, astronomer, and geographer! His geocentric model of the universe was a sophisticated mathematical framework that accurately predicted celestial movements. We’ll explore his book “Almagest”, which provided tables for predicting eclipses, planetary positions, and other astronomical events with remarkable accuracy.

Seth and Cesar talk about Ptolemy’s model and his explanation for planetary retrograde motion. Ptolemy created a physical model to explain why planets, or “wanderers” as the Greeks called them, appeared to move, i.e. the backward motion of mars. They discuss how ancient astronomy tried to make sense of the night sky using a geocentric model.

We’ll also discuss how Ptolemy’s model was widely accepted by scholars in the Middle Ages and remained a cornerstone of astronomy until the Renaissance. Contrary to popular misconceptions, the Catholic Church didn’t reject scientific inquiry or truth; instead, they accepted Ptolemy’s geocentric model because it was mathematically accurate and made predictions that matched observations.

We’ll also highlight the importance of trigonometry in Ptolemy’s work, which laid the foundation for later scientists like Copernicus and Galileo to develop more accurate models of the universe. So, if you’re curious about ancient Greek astronomy, mathematics, or want to learn more about how faith and reason can coexist, be sure to watch this video until the end!

Get your Nerdy Catholic merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic

 

The Man Who Cried Eureka! – Nerding Out ep31

By Uncategorized
Subscribe on YouTube

Are you ready to unlock the secrets of ancient Greek physics and discover how it paved the way for modern scientific breakthroughs? Join us on Nerding Out as hosts Seth and Cesar take you on an epic journey through the life and work of Archimedes, one of history’s most fascinating figures. From his groundbreaking discoveries in mechanics to his courageous defense of his city against the Roman army, we’ll delve into the remarkable story that has inspired scientists for centuries.

As we explore Archimedes’ contributions, you’ll see how he used mathematical concepts to describe physical phenomena and laid the groundwork for later breakthroughs in mathematics and physics. You’ll also learn about the cultural context in which Archimedes lived and worked, highlighting the social and intellectual climate that fostered his innovative ideas. By exploring the life and work of Archimedes, we’ll demonstrate how science can be a powerful tool for positive change and personal growth. Throughout the episode, Seth and Cesar will share their own experiences, highlighting the importance of curiosity, perseverance, and intellectual humility.Join us on this exciting adventure through the history of physics and discover why Archimedes’ story is still relevant today!

Get your Nerding Out merch at https://thatnerdycatholic.com/merch
Support That Nerdy Catholic at https://thatnerdycatholic.com/support
Facebook: https://www.facebook.com/thatnerdycatholic/
Instagram: https://www.instagram.com/ThatNerdyCatholic