Waymo robotaxis drive themselves using a combination of sensors, onboard software, and remote human assistance. This guide explains how each layer works, from the hardware that sees the road to the people who step in when the car gets confused.
What You’ll Need
- No special equipment — this is a conceptual guide.
- Basic familiarity with terms like LiDAR, radar, and cameras is helpful but not required.
Step-by-Step
- Understand the sensor suite. Waymo’s current system (the fifth-generation Driver) uses a combination of three main sensor types mounted on the roof and around the vehicle:
- LiDAR (Light Detection and Ranging): Fires laser pulses and measures how long they take to bounce back, creating a 3D point cloud of the surroundings. It works in the dark and gives precise distance measurements.
- Radar: Uses radio waves to measure the speed and distance of objects, especially useful in rain, fog, or snow where LiDAR and cameras struggle.
- Cameras: Capture high-resolution color images, used for reading traffic lights, road signs, lane markings, and identifying objects like pedestrians or cyclists.
- Know what each sensor contributes. No single sensor is enough. LiDAR gives accurate 3D geometry, radar gives reliable velocity, and cameras give semantic understanding (what an object is). The software fuses all three into a single, unified view of the world.
- See how the software processes the data. The onboard computer takes the raw sensor streams and runs several processing stages in real time:
- Perception: Detects objects (cars, pedestrians, bikes, barriers), classifies them, and estimates their position, size, and velocity.
- Localization: Determines the car’s exact position on a high-definition map (accurate to a few centimeters) using GPS, inertial sensors, and matching live sensor data against pre-mapped features like lane lines and building edges.
- Prediction: Forecasts where detected objects will be in the next few seconds, considering their current motion and the road rules.
- Planning: Decides the safest and most comfortable path, including lane changes, turns, and stopping at lights. It evaluates many possible trajectories and picks the one that minimizes risk.
- Control: Sends commands to the steering, throttle, and brakes to execute the planned path smoothly.
- Recognize the role of high-definition maps. Waymo relies on extremely detailed maps that include lane geometry, traffic signal locations, stop signs, crosswalks, and even curb heights. The car does not navigate by sensors alone; it uses sensors to confirm and update its position within this pre-built map.
- Understand remote assistance. When the car encounters an unusual situation it cannot resolve confidently — a construction zone with unclear signs, a police officer directing traffic, or a blocked lane — it does not just stop. It sends a request to a remote assistance center.
- See what remote assistance does (and doesn’t do). A remote operator, trained on Waymo’s system, views a sanitized version of the car’s surroundings (with faces and license plates blurred for privacy). They can:
- Verify what the car is seeing and label ambiguous objects.
- Suggest a new route or a safe maneuver.
- Clear the car to proceed when it is waiting unnecessarily.
Critically, the remote operator does not drive the car directly. They provide high-level guidance, and the onboard software executes the actual steering and braking.
- Know the escalation path. If the car is truly stuck — for example, a road is completely closed with no legal way around — remote assistance can guide it to a safe pull-over spot and call for a human support vehicle to retrieve it.
- Consider the safety layers. The system has multiple redundancies: separate power supplies, braking systems, and computing units. If a critical component fails, the car safely pulls over and stops. The software also has a “minimal risk condition” — a pre-planned safe stop maneuver it can execute at any time.
- Note the current operational limits. Waymo operates in specific geographic areas (like parts of Phoenix, San Francisco, and Los Angeles) under certain weather and speed conditions. It does not drive everywhere or in all conditions yet.
Common Mistakes
- Thinking remote assistance is remote driving. Many people assume a human is joysticking the car. In reality, the human gives suggestions; the car executes them.
- Believing LiDAR is the only sensor. LiDAR is critical, but cameras and radar are equally essential for a complete picture.
- Assuming the car “sees” like a human. It doesn’t interpret a scene; it matches sensor data to a pre-built map and detects objects as labeled point clouds and boxes.
- Overestimating the maps. The maps are not updated live by the car; they are periodically refreshed by dedicated mapping vehicles. The car can handle small changes but relies on remote help for major ones.
- Thinking the car can drive anywhere. It is geofenced to specific service areas and may refuse trips outside them.
Tips
- Watch for the sensor dome. The spinning cylinder on the roof is the main LiDAR; the other sensors are integrated into the roof rack and bumpers.
- Notice how the car behaves at complex intersections. It often waits longer than a human would, because its planning algorithm prioritizes safety over speed.
- If you ride in one, pay attention to the screen. It shows what the car perceives — you’ll see other vehicles as boxes and pedestrians as stick figures, which makes the fusion process visible.
- Understand the “disengagement” term. When the car hands control to a human test driver (during testing phases), it’s called a disengagement. In fully autonomous rides, there is no steering wheel, so this doesn’t apply.
- Check Waymo’s official website for current service areas. Availability changes as the service expands.
Troubleshooting
- Car stops in the middle of the road. This is usually a “pull over” response to a sensor fault or an unclear situation. Wait; it will either resume or a support vehicle will arrive.
- Car circles the block. It may be looking for a safe pickup point or a legal parking spot. If it persists, contact support through the app.
- Car ignores a temporary traffic light. Temporary signals are notoriously hard for the perception system. Remote assistance usually intervenes quickly.
- Ride is canceled mid-trip. This can happen if the car detects a system fault or the route becomes impassable. You’ll get a notification and a refund.
- No service in your area. The system is geofenced; check the official coverage map before expecting a ride.
Frequently Asked Questions
Q: Can a remote operator take full control of the car?
A: No. They can give route suggestions or clear the car to proceed, but the onboard software always executes the physical driving.
Q: What happens if the internet connection drops?
A: The car continues driving safely using its onboard maps and sensors. Remote assistance is only needed for unusual situations; normal driving does not require a live connection.
Q: How accurate is the localization?
A: Waymo claims centimeter-level accuracy, which is why the car can confidently drive in narrow lanes and close to curbs.
Q: Does the car work in heavy rain or snow?
A: It handles light rain well due to radar, but heavy precipitation or snow-covered roads can degrade sensor performance and may cause the car to pull over or decline a trip.
Q: How many sensors does the car have?
A: The exact count varies by generation, but the fifth-generation system includes 29 cameras, 6 radars, and 4 LiDAR units, along with additional audio sensors for detecting emergency vehicle sirens.
Q: Is the car ever fully autonomous without any human involvement?
A: In the rider-only service, yes — there is no safety driver in the car. However, remote assistance is always available as a backup layer.
Q: What happens if a sensor gets dirty or blocked?
A: The system detects degraded sensor performance and will either clean the sensor (some models have a washer) or pull over safely and request service.
Related
General steps for current mainstream versions; menus can differ by device and version. See the disclaimer or report an error.
More in this bed
- Fix Apps Not Downloading From Play Store
- Secure a Samsung Galaxy After a Zero-Day Disclosure
- What to Check Before Installing Linux Alongside Windows
- Fix OEM Activation Error 0xc004c060 in Windows 10
- Why Does My App Run One Query for the List and One per Item?
- Fix Google Chrome Has Stopped Working