Machines Learn Better if We Teach Them the Basics

FromQuanta Science Podcast

Start listening View podcast show

Machines Learn Better if We Teach Them the Basics

FromQuanta Science Podcast

ratings:

Length:

21 minutes

Released:

Jul 5, 2023

Format:

Podcast episode

Description

A wave of research improves reinforcement learning algorithms by pre-training them as if they were human. Read more at QuantaMagazine.org. Music is “Quasi Motion” by Kevin MacLeod.

Released:

Jul 5, 2023

Format:

Podcast episode

Titles in the series (100)

In-depth news about mathematics, physics, biology and computer science.

Skip carousel

How Life and Luck Changed Earth’s Minerals: How life and luck changed Earth's minerals. by Quanta Science Podcast
34 min listen
A New Map Traces the Limits of Computation: A major advance in computational complexity reveals deep connections between the classes of problems that computers can — and can’t — possibly do. by Quanta Science Podcast
27 min listen
At Tiny Scales, a Giant Burst on Tree of Life: At tiny scales, a giant burst on tree of life. by Quanta Science Podcast
20 min listen
How Mutant Viral Swarms Spread Disease: A new understanding of viral swarms is helping researchers predict how viruses will evolve and where disease is likely to spread. by Quanta Science Podcast
28 min listen
The Mutant Genes Behind the Black Death: Only a few genetic changes were enough to turn an ordinary stomach bug into the bacteria responsible for the plague. by Quanta Science Podcast
27 min listen
Visions of Future Physics: Nima Arkani-Hamed is championing a campaign to build the world’s largest particle collider, even as he pursues a new vision of the laws of nature. by Quanta Science Podcast
33 min listen
Gravitational Waves Discovered at Long Last: This week: Long sought-after gravitational waves are found and a proposed fuzzball fix for a black hole paradox. by Quanta Science Podcast
35 min listen
Einstein’s Parable of Quantum Insanity: Einstein refused to believe in the inherent unpredictability of the world. Is the subatomic world insane, or just subtle? by Quanta Science Podcast
24 min listen
Mongrel Microbe Tests Story of Complex Life: A newly discovered class of microbe could help to resolve one of the biggest and most controversial mysteries in evolution — how simple microbes transformed into the complex cells that produced animals, plants and fungi. by Quanta Science Podcast
30 min listen
New Letters Added to the Genetic Alphabet: Scientists hope that new genetic letters, created in the lab, will endow DNA with new powers. by Quanta Science Podcast
24 min listen
A Surprise Source of Life’s Code: A surprise source of life’s code. by Quanta Science Podcast
34 min listen
The Neuroscience Behind Bad Decisions: Irrationality may be a consequence of the brain’s ravenous energy needs. by Quanta Science Podcast
14 min listen
Physicists Hunt for the Big Bang’s Triangles: The story of the universe’s birth — and evidence for string theory — could be found in triangles and myriad other shapes in the sky. by Quanta Science Podcast
26 min listen
How Humans Evolved Supersize Brains: Scientists have begun to identify the symphony of biological triggers that powered the extraordinary expansion of the human brain. by Quanta Science Podcast
37 min listen
New Clues to How the Brain Maps Time: The same brain cells that track location in space appear to also count beats in time. The research suggests that our thoughts may take place on a mental space-time canvas. by Quanta Science Podcast
26 min listen
The New Laws of Explosive Networks: How explosive networks form. by Quanta Science Podcast
22 min listen
The Incredible Shrinking Sex Chromosome: Nature offers species a panoply of ways to determine an organism’s sex. That flexibility suggests we need not be concerned about losing sex chromosomes, but it raises the question of why such a fundamental property is so variable. by Quanta Science Podcast
30 min listen
The Quantum Secret to Superconductivity: In a virtuoso experiment, physicists have revealed details of a “quantum critical point” that underlies high-temperature superconductivity. by Quanta Science Podcast
24 min listen
A Twisted Path to Equation-Free Prediction: Complex natural systems defy standard mathematical analysis, so one ecologist is throwing out the equations. by Quanta Science Podcast
32 min listen
A New Design for Cryptography’s Black Box: A two-year-old cryptographic breakthrough has proven difficult to put into practice. But new advances show how near-perfect computer security might be surprisingly close at hand. by Quanta Science Podcast
25 min listen
Debate Intensifies Over Dark Disk Theory: In the new, free-for-all era of dark matter research, the controversial idea that dark matter is concentrated in thin disks is being rescued from scientific oblivion. by Quanta Science Podcast
14 min listen
Scientists Debate Signatures of Alien Life: Searching for signs of life on faraway planets, astrobiologists must decide which telltale biosignature gases to target. by Quanta Science Podcast
25 min listen
How the Body’s Trillions of Clocks Keep Time: Cellular clocks are almost everywhere. Clues to how they work are coming from the places that they’re not. by Quanta Science Podcast
31 min listen
After Black Holes Collide, a Puzzling Flash: A satellite spotted a burst of light just as gravitational waves rolled in from the collision of two black holes. Was the flash a cosmic coincidence, or do astrophysicists need to rethink what black holes can do? by Quanta Science Podcast
22 min listen
Landmark Algorithm Breaks 30-Year Impasse: Computer scientists are abuzz over a fast new algorithm for solving one of the central problems in the field. by Quanta Science Podcast
30 min listen
How to Build Life in a Pre-Darwinian World: Perhaps chemistry played a more instrumental role in the origin of life than scientists thought. by Quanta Science Podcast
29 min listen
New Evidence for the Necessity of Loneliness: A specific set of neurons deep in the brain may motivate us to seek company, holding social species together. by Quanta Science Podcast
13 min listen
Math Quartet Joins Forces on Unified Theory: A new breakthrough that bridges number theory and geometry is just the latest triumph for a close-knit group of mathematicians. by Quanta Science Podcast
31 min listen
Sphere Packing Solved in Higher Dimensions: The Ukrainian mathematician Maryna Viazovska has solved the centuries-old sphere-packing problem in dimensions eight and 24. by Quanta Science Podcast
22 min listen
Can Microbes Encourage Altruism?: Can gut bacteria persuade their hosts to be selfless? by Quanta Science Podcast
16 min listen

More Episodes from Quanta Science Podcast

Skip carousel

New Cell Atlases Reveal Untold Variety in the Brain and Beyond: Scientists can fingerprint the function of tens of thousands or even millions of cells in a single experiment. This expansive data may fundamentally reshape our understanding of human anatomy and biology. by Quanta Science Podcast
21 min listen
Extra-Long Blasts Challenge Our Theories of Cosmic Cataclysms: Everything is made of stardust. Gamma-ray bursts may help physicists learn how each element in the periodic table is born in the cosmos. by Quanta Science Podcast
25 min listen
Meet Strange Metals: Where Electricity May Flow Without Electrons: When it comes to bizarre forms of electricity, superconductivity is just the beginning. by Quanta Science Podcast
21 min listen
In the Gut's 'Second Brain,' Key Agents of Health Emerge: Gut feelings, like the stomachache one might get from overeating, are driven by the enteric "second brain" in our digestive systems. by Quanta Science Podcast
17 min listen
During Pregnancy, a Fake 'Infection' Protects the Fetus: The placenta has a unique trick for keeping immune defenses on standby, even when no viral infections threaten a pregnancy. by Quanta Science Podcast
10 min listen
Why the Human Brain Perceives Small Numbers Better: A recent neurological study provides an unprecedented look at how number sense works in the human brain. by Quanta Science Podcast
21 min listen
Inside Scientists' Life-Saving Prediction of the Iceland Eruption: An Icelandic peninsula that hadn't seen any volcanism for 800 years has now awoken. Eruptions could continue for decades or even centuries. by Quanta Science Podcast
22 min listen
Echoes of Electromagnetism Found in Number Theory: Physics is a rich well of inspiration for mathematicians to draw from. by Quanta Science Podcast
21 min listen
Tiny Language Models Come of Age: Using large language models to generate training data for smaller models might be more effective than vacuuming up text from the internet and filtering out the garbage. by Quanta Science Podcast
21 min listen
Rogue Worlds Throw Planetary Ideas Out of Orbit: Astronomers have long known of rogue worlds - cosmic loners that drift through space, untethered to a star. Now JWST is spotting them in pairs. by Quanta Science Podcast
22 min listen
What Makes Life Tick? Mitochondria May Keep Time for Cells: We're all used to hearing about mitochondria as the powerhouse of the cell. It turns out that they are also the timekeepers. by Quanta Science Podcast
24 min listen
An Old Conjecture Falls, Making Spheres a Lot More Complicated: Many discoveries in mathematics make things simpler, but a recent disproof instead creates a universe of new, complicated possibilities. by Quanta Science Podcast
17 min listen
Even Synthetic Life Forms With a Tiny Genome Can Evolve: Biologists have discovered that even one of the weakest, simplest self-replicating organisms on the planet can evolve. by Quanta Science Podcast
15 min listen
Selfish, Virus-Like DNA Can Carry Genes Between Species: Genetic elements known as "Mavericks" may be responsible for transferring genes between different species throughout the history of life. by Quanta Science Podcast
13 min listen
Exoplanets Could Help Us Learn How Planets Make Magnetism: Earth has a magnetic field, but Venus, Earth's sister planet, doesn't. Why does one rocky planet have a magnetic field while the other does not? by Quanta Science Podcast
13 min listen
To Move Fast, Quantum Maze Solvers Must Forget the Past: If you've ever entered a room, and then completely forgotten how you got there, you may have something in common with a quantum computer. by Quanta Science Podcast
16 min listen
Underground Cells Make 'Dark Oxygen' Without Light: In the groundwaters beneath Alberta, Canada, researchers have found microbes that can produce abundant oxygen, even in the absence of light. by Quanta Science Podcast
14 min listen
How the Brain Protects Itself From Blood-Borne Threats: A system of sophisticated pumps and receptors protects the brain like bouncers at the door of an elite club. by Quanta Science Podcast
12 min listen
JWST Spots Giant Black Holes All Over the Early Universe: There's never been a more exciting time to study black holes. by Quanta Science Podcast
25 min listen
Is It Real or Imagined? How Your Brain Tells the Difference.: A recent neuroscience study reveals how human brains differentiate between the imagined and the observed. by Quanta Science Podcast
18 min listen
Chatbots Don't Know What Stuff Isn't: Researchers still don't understand whether machines will ever truly know the word "no." by Quanta Science Podcast
17 min listen
Global Microbiome Study Gives New View of Shared Health Risks: A recent study found that the more time you spend with someone, the more likely you are to share strains of species in your microbiome. by Quanta Science Podcast
21 min listen
Physicists Use Quantum Mechanics to Pull Energy out of Nothing: A recently demonstrated quantum protocol teleports energy from one location to another without violating any sacred physical principles. by Quanta Science Podcast
19 min listen
How Loneliness Reshapes the Brain: Loneliness doesn't just make people feel isolated. It alters their brain in ways that can hinder their ability to trust and connect to others. by Quanta Science Podcast
21 min listen
Gene Expression in Neurons Solves a Brain Evolution Puzzle: Our brains have even less in common with reptile brains than was once thought. by Quanta Science Podcast
20 min listen
The Cause of Depression Is Probably Not What You Think: Better treatments for depression may require a clear-eyed look at the condition's nuance. by Quanta Science Podcast
22 min listen
Ants Live 10 Times Longer by Altering Their Insulin Responses: A tapeworm has evolved the ability to make its ant hosts live longer. Researchers recently discovered how the parasite does it. by Quanta Science Podcast
18 min listen
How the Brain Distinguishes Memories From Perceptions: The "blurriness" of remembered images may help our brains distinguish memories from current perceptions. by Quanta Science Podcast
14 min listen
What Causes Alzheimer's? Scientists Are Rethinking the Answer. (Pt 2): Researchers investigating alternatives to amyloid plaques as the possible cause of Alzheimer's disease have faced resistance, but intriguing new theories have emerged. by Quanta Science Podcast
41 min listen
What Causes Alzheimer's? Scientists Are Rethinking the Answer. (Pt. 1): For three decades, most Alzheimer's researchers have stuck by the theory that aggregations of proteins called amyloid plaques cause the disease. But unsatisfied with the slow pace of progress, some are now exploring other hypotheses. by Quanta Science Podcast
34 min listen

Related podcast episodes

Skip carousel

The Cause of Depression Is Probably Not What You Think: Better treatments for depression may require a clear-eyed look at the condition's nuance. by Quanta Science Podcast
22 min listen
The Past, Present, and Future of Deep Learning In PyTorch: An interview with the creator of the popular PyTorch deep learning framework by The Python Podcast.__init__
42 min listen
Declarative Machine Learning For High Performance Deep Learning Models With Predibase by The Python Podcast.__init__
59 min listen
Designing Data Transfer Systems That Scale: The first step of data pipelines is to move the data to a place where you can process and prepare it for its eventual purpose. Data transfer systems are a critical component of data enablement, and building them to support large volumes of information is a complex endeavor. Andrei Tserakhau has dedicated his careeer to this problem, and in this episode he shares the lessons that he has learned and the work he is doing on his most recent data transfer system at DoubleCloud. by Data Engineering Podcast
64 min listen
Ep. 25: Google's Ian Goodfellow on How an Argument in a Bar Led to Generative Adversarial Networks: How an argument in a bar led Google's Ian Goodfel… by The AI Podcast
24 min listen
An Introduction to Event Storming and Event Modeling | Rafal Maciag (Founder & CEO, ModelingEvolution) by The Product Development Podcast
39 min listen
Are LLMs Overhyped or Underappreciated? with Marti Hearst - #626 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
38 min listen
How Loneliness Reshapes the Brain: Loneliness doesn't just make people feel isolated. It alters their brain in ways that can hinder their ability to trust and connect to others. by Quanta Science Podcast
21 min listen
What is beyond PoCs? ML project-hurdles you should be prepared to take with Balázs Kégl - 016: Why do we do PoCs all the time and why do we struggle with Real projects? We are going to talk about ML project-hurdles with the head of AI at Huawei Paris, Balazs Kegl. by Machine Learning Cafe
56 min listen
Hyperparameter Optimization through Neural Network Partitioning with Christos Louizos - #627 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
33 min listen
Can we predict the accuracy of a Neural Network? Yes, with the WeightWatcher tool by Charles Martin, Ph.D. - 002: In this episode we do a deep dive into deep neural networks. What conclusions can we make looking at the distribution of eigenvalues of each layer? by Machine Learning Cafe
57 min listen
Currents 082: Dan Shipper on Practical Applications of GPT-3: Jim talks with Dan Shipper about practical uses of GPT-3 and ChatGPT at the personal and small-business scale. by The Jim Rutt Show
59 min listen
Recurrent Neural Nets: This week, we're doing a crash course in recurren… by Linear Digressions
13 min listen
Localizing and Editing Knowledge in LLMs with Peter Hase - #679 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
50 min listen
Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
43 min listen
How LLMs and Generative AI are Revolutionizing AI for Science with Anima Anandkumar - #614 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
62 min listen
#364 - Stuart Russell - The Terrifying Problem Of AI Control: Stuart Russell is a Professor of Computer Science at the University of California and an author. Programming machines to do what we want them to is a challenge. The consequences of getting this wrong become very grave if that machine is... by Modern Wisdom
112 min listen
Keeping Your Data Warehouse In Order With DataForm - Episode 102: An interview about Dataform and how it helps you to keep your data warehouse in good working order by Data Engineering Podcast
47 min listen
Terraform and The Art of Teaching Tech with Ned Bellavance by Screaming in the Cloud
35 min listen
BI 124 Peter Robin Hiesinger: The Self-Assembling Brain: Support the show to get full episodes and join the Discord community. Robin and I discuss many of the ideas in his book The Self-Assembling Brain: How Neural Networks Grow Smarter. The premise is that our DNA encodes an algorithmic growth process by Brain Inspired
99 min listen
Experimentation and A/B Testing For Modern Data Teams With Eppo: An interview with Eppo founder Chetan Sharma about the challenges of designing, running, and analyzing product experiments and the work that he is doing to make it more accessible to organizations of every size. by Data Engineering Podcast
58 min listen
AI Agents and Data Integration with GPT and LLaMa with Jerry Liu - #628 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
41 min listen
#119 - Becoming a Professional Agile Leader - Ron Eringa by Tech Lead Journal
51 min listen
Ilya Sutskever: Ilya Sutskever, a cofounder and chief scientist of OpenAI and one of the primary minds behind the large language model GPT-4 and it’s public progeny, ChatGPT, talks about AI hallucinations and his vision of AI democracy. by Eye On A.I.
43 min listen
#1 - Startup Tech Leadership - Jerome Poudevigne by Tech Lead Journal
47 min listen
020 Natural Language Processing 3: Natural Language Processing classical/shallow algorithms. ocdevel.com/mlg/20 for notes and resources by Machine Learning Guide
41 min listen
TestContainers to Reduce Developer Frustration by The Cloudcast
30 min listen
Episode 15: A Look Inside Ultrasound: An investigation into ultrasound and the material properties that make it work. by Materialism: A Materials Science Podcast
40 min listen
Beam and Spark with Holden Karau: This week our colleague, Holden Karau, joins us to talk about Spark and Beam. by Google Cloud Platform Podcast
35 min listen
OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - #674 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
32 min listen

Discover this podcast and so much more

Machines Learn Better if We Teach Them the Basics

Machines Learn Better if We Teach Them the Basics

Description

Titles in the series (100)

More Episodes from Quanta Science Podcast

Related podcast episodes