AR
Niantic Uses Meta Llama to Bring Digital Creatures to Life
Niantic uses advanced computer vision algorithms to convert physical-world images from a player’s camera into accurate 3D models. This technology lets the Dots interact with their surroundings. Using the Niantic Lightship ARDK, the Dots recognize physical objects like flowers, food, and pets. These observations are then processed by a custom version of Llama 2, which considers each Dot’s unique traits—such as personality and history—to determine how these virtual creatures might react to their discoveries.