Eureka bridges the gap between high-level reasoning (coding) and low-level motor control. It is a “hybrid-gradient architecture”: a black box, inference-only LLM instructs a white box, learnable neural network. The outer loop runs GPT-4 to refine the reward function (gradient-free), while the inner loop runs reinforcement learning to train a robot controller (gradient-based).
RL community should be in awe and shocked by the Eureka paper. The idea here is that you feed the source code of the environment to GPT-4 and ask it to write code for the reward function itself! Then you evaluate this reward function in simulation and provide your evaluation results back to GPT-4 so it can make improvements to the reward function!! You do this over and over and RL eventually ends up achieving superhuman results in lots of different challenges, all without human intervention!!!
How to Fake Everything with AI (Why Does This Exist?)
02:17 – Auto-translate your videos
03:44 – Animate your videos
05:57 – Change your scene
08:01 – Change your voice to a celebrity’s
10:55 – Relighting your scene
12:19 – How to deep fake yourself
How to blend images in Dalle3
How to blend images in Dalle3:
1) uniquely identify the images
2) Ask to blend the images
Step 1: How to uniquely identify the image in the chat window?
One method: by adding custom instructions
“In dalle3 always assign a unique identifier to each image. display… twitter.com/i/web/status/1…
— Anu Aakash (@anukaakash)
Oct 22, 2023
A difference in company philosophy:
@neuralink: put wires on brain.
@CorticalLabs: grow brain on wires.
Cortical Labs just completely changed my dreams and nightmares.
Here it is in Hon Weng’s hotel room. He is showing this off tomorrow at a brain conference in San… twitter.com/i/web/status/1…
— Robert Scoble (@Scobleizer)
Oct 23, 2023
Fun Fact: Did you know AMD CEO and Nvidia CEO, two of the biggest suppliers of artificial intelligence hardware are related?
Prompt of the Day 🍭: Salary Negotiator
Hope you enjoyed today’s newsletter
⚡️ Join over 200,000 people using the Superpower ChatGPT extension on Chrome and Firefox.