Speaking of, I saw first-hand many of the Real Tone improvements in the new Pixel 9 series compared to its predecessor in the studio and on our photo walk around the neighborhood with Koenigsberger and his team. One of the most notable is photographing a backlit subject in front of a window because the Real Tone algorithm now prioritizes faces in photos and video, reducing huge swings in exposure, like when a dark-skinned person is in a bright setting.

Properly exposing darker skin tones was not a priority for film camera systems from the mid to late 1900s. Kodak's Shirley Card featured a photo of a white woman and was the tool used to calibrate the colors for printing images across the US. While many of these issues have been addressed in the digital era, it's far from resolved. It's still not hard to find criticisms of how black skin tones appear in media, from magazine covers to feature films, often for lightening the skin tone. And remember when webcams on HP computers failed to track the facial features of a black man but had no trouble with a white woman?

When not seeing patients, Dr. Bahoshy enjoys swimming, going to the gym, and spending time with his wife Cynthia, and their two young boys, Pierre and Leo.

While in optometry school, Dr. Bahoshy spent two summers as a researcher at the world-renowned Centre for Contact Lens Research (CCLR) at the University of Waterloo, School of Optometry, learning about the latest in contact lens technology.

After you snap a photo, you can hop into Magic Editor and “Reimagine” your image. This lets you enter a text prompt to alter the image. Want to add a UFO in the sky? Just type it in and, after a minute, you'll get some options to choose from. Want to change the sky from day to night? Go ahead. The quality of the results can vary (and depends on how descriptive the prompt is), but it's opening the floodgates to change the photograph completely.

Take the video example below. The Pixel 8 Pro tries to adjust the exposure for the whole scene, and it swings greatly, making the model appear super dark when pulling away from the window and brightening her skin when getting close up. On the Pixel 9 Pro, while there are still some adjustments in exposure happening, it's not as huge of a shift, and the model's facial features are more visible.

This setup lets the team take photos of subjects and use that data to improve the Real Tone algorithm baked into Google's Pixel phones in the hopes of delivering a more accurate representation of skin in every photo captured. And yes, while the feature launched to better serve darker skin tones, it has also helped improve the rendering of lighter skin tones in varied lighting.

Analyzing photos captured at the scene, it wasn't hard to discern the updates to the algorithm, especially with the luxury of having the models right in front of me. Even in normal lighting conditions, skin tones on the Pixel 9 Pro had a much closer match to the people in real life, in my eyes, over the Pixel 8 Pro. Koenigsberger says these are also due to broad changes in Google's HDR+ imaging pipeline (more on this later), which enables the system to produce more accurate shadows and mid-tones.

Your optometrist will likely recommend an OCT exam if you have an increased risk of eye disease. You probably have an increased risk if you are over age 50 or have:

Special Optics

Dr. Bahoshy attended the University of Waterloo, where he graduated with an Honours Bachelor of Science Degree (B.Sc), as well as a Doctor of Optometry (OD) Degree.

Another clear example of this is when a model lifted a surgical mask to her face—her skin darkens more in the Pixel 8 Pro video, whereas there isn't as much of a swing on the Pixel 9 Pro. This also affects situations where you have multiple people of different skin tones together, and Koenigsberger says there should be fewer distortions in exposure.

Even if you don’t have a high risk of eye disease, OCT exams are still a great way to help protect your eye health. By having OCT exams regularly, it creates a baseline that your optometrist can reference. Using this baseline, your optometrist can detect the smallest changes to your eyes over time.

Depending on your risk level or history of eye disease, your optometrist might recommend that your eyes are dilated during the OCT exam. Dilating your eyes is a simple procedure and gives your optometrist an even larger view of your retina.

But of course, your eyewear is much more than just your frames. We offer Zeiss lenses; the paragon of quality lens technology. By pairing the best in optical lenses with filters and coatings for improved performance, Stoney Creek Eye Care & Eyewear Boutique is here to help you look your best, see your best, and feel your best.

“Everybody is a paid and notified, willing participant," he says. "We work with a couple of different agencies to do model recruitment and make sure we’re doing at or above market rate for that, and we've tried to work with people over time as well mostly because it's really impactful for the people who participate in the project to see the changes in the technology.”

New camera features in Pixel phones increasingly focus on specific instances rather than broad strokes changes to the general camera experience, though Reynolds says the HDR+ pipeline has been rebuilt in the Pixel 9 series. It retunes the exposure, sharpening, contrast, and shadows merging—plus all of the updates to Real Tone—which help create a more “authentic” and “natural" image, according to Reynolds. He suggests it's what people prefer compared to the more processed, punchy, and heavily filtered images that were so popular a decade ago.

In particular, OCT can help diagnose forms of glaucoma that don’t cause increased intraocular pressure and therefore, can’t be diagnosed with standard glaucoma tests.

You may have heard your optometrist recommend OCT imaging during your eye exam, but what is it really? OCT is a powerful tool your optometrist uses to monitor your eye health and diagnose eye disease.

From start to finish, an OCT exam takes about 10 minutes. The exam is non-invasive and painless. You simply place your chin into a chin rest and keep your eye open as you look at a target (often a blinking dot or a small picture). Then, without touching it, the OCT machine scans your eye.

Much of this work targets the “workflow” rather than the capture process itself. Reynolds points out that, currently, creative professionals have a workflow where they plan a shoot, set up cameras, capture the subject, then move the media to an editing platform, sort through the photos, and edit the images. The camera is a very small part of that.

In addition to producing detailed images of the retina, OCT can also show the optic nerve, which is the part of the eye affected by glaucoma. OCT can help with diagnosing glaucoma by showing damage and changes to the optic nerve.

Raskar’s new prediction? A “non-camera.” No sensor, no lens, no flash, just a single button. All it does is capture your GPS location and time of day and you can say, “Hey, I’m with my family and friends” in front of the Eiffel Tower, and it will compose the picture since it knows the time, date, location, and weather.

It's why a feature like Real Tone hits home for Koenigsberger. “My dad is a white German, my mom is a very dark-skinned black Jamaican woman, and my brother and I are two different colors,” he says. “Trying to get that family photo has historically not been the easiest on any device, and I feel like every year I actually get to live the truth at home.”

Arguably most important is the fact that Real Tone for the first time has been tested for all of Google's “Hero” features across the Pixel 9 range. Koenigsberger says his team has been able to scale up testing to ensure new features like Add Me have been tested for Real Tone before launch. That's important because Koenigsberger says his team isn't always able to spend as much time testing on the A-series Pixel phones, which might be why I had some issues with Real Tone on the Pixel 8A. Scaling this process up will hopefully help, but Koenigsberger says it brings Real Tone from a specific set of technologies into Google's operating philosophy.

At Stoney Creek Eye Care & Eyewear Boutique our trusted team of eye doctors is committed to providing you with high-quality eye care, stylish frames, and personalized attention. We offer a wide variety of services, including:

“It's about what you're remembering," he says. “When you define a memory as that there is a fallibility to it: You could have a true and perfect representation of a moment that felt completely fake and completely wrong. What some of these edits do is help you create the moment that is the way you remember it, that's authentic to your memory and to the greater context, but maybe isn't authentic to a particular millisecond.”

“We are not just inserting ourselves into this narrow slot built for a camera," Reynolds says. "I would like to insert ourselves into this broader, longer sequence of creation people are increasingly going through because that's the problem to solve."

OCT provides detailed images of the retina and macula, showing irregularities caused by AMD. With OCT imaging, your optometrist can detect signs of AMD like drusen (tiny clumps of protein) caused by dry AMD and abnormal blood vessels and bleeding caused by wet AMD.

USBcamera

All of those updates will impact your day-to-day photo and video needs, but what about the special moments? The hike up that mountain in Australia that you saved up hundreds of dollars for? That once-in-a-lifetime family photo at the Grand Canyon? That's where some of these new features come in.

OCT provides your optometrist with a wealth of information about your eye health. Whether you’re at risk for eye disease or simply having a routine eye exam, OCT images are a valuable tool that provide valuable insight.

The smart lights in the studio are voice-controlled, and I spotted a Google Wi-Fi router in a corner—the team uses commands via a Nest Audio smart speaker to cycle through the varied lighting conditions it uses in testing. To darken the space and simulate nighttime settings, it's a bit more manual; Koenigsberger uses a step ladder to mount blackout curtains along the windows.

That brings us to the generative artificial intelligence features increasingly making their way into Google's Pixel phones. Last year, the company debuted Magic Editor, which lets you move subjects in the frame from one end of the photo to the other, and AI will fill in the area where the subject is no longer present by generating pixels. This year there are even more GenAI features, most notably one called Reimagine.

But Google has a poor record when it comes to gathering data, Notably, after the launch of the Pixel 4 and its new face-scanning feature, the company came into hot water when a third-party contractor was caught targeting homeless people with darker skin for 3D facial scans, offering $5 gift cards and rushing them through consent forms without fully explaining what the data was being used for. Thankfully, that's not a practice in Koenigsberger’s studio.

Koenigsberger says his inspiration came directly from Aperture magazine's Vision & Justice issue in 2016, guest edited by Sarah Lewis, who teaches history of art and architecture and African and African American studies at Harvard University. The issue covers the contributions of African Americans to the histories of film and photography.

Navitar

OCT is a great tool in diagnosing eye disease. In some cases, OCT can help your optometrist diagnose eye disease earlier, which allows for more effective treatment. Because OCT images give your optometrist such a detailed view of your retina, they can detect small indications of eye disease.

“Did Real Tone get worse?” That was one of my criticisms of the Pixel 8A when I reviewed it a few months ago. Google’s midrange smartphone packs a wallop for $500, but Real Tone, the camera feature designed to produce more accurate skin tones, especially for people of color, was a bit of a mixed bag. My siblings and parents said as much when we compared selfies to competing phones in the same price bracket.

Also in the studio was Cootchill Nelson, Google's image quality engineer and the photographer who leads many of these shoots, along with several models of varying ethnicities and skin tones. Nelson captures photos of these models with different colored backdrops and various lighting, and they often walk around the neighborhood to photograph scenes outside. This particular setup involved a Pixel 8 Pro and a Pixel 9 Pro mounted onto a single rig to capture the same photos and videos side by side. It's not unlike the way I test smartphone cameras in reviews.

“In all of my education, I feel like I had never somehow been told or seen who these photographers were, what their contributions were, and seeing my community represented in the way that their eyes did," he says. "And so it begged this larger question: With my time at Google, what is something that only I can do while I'm here? What is the company well positioned to do with its expertise in computational photography, and where could we really look at like a flip-the-switch moment for a problem that has existed for decades and decades and decades."

Pixelink

Today, Dr. Bahoshy is an active member of the Ontario Association of Optometrists (OAO), the Canadian Association of Optometrists (CAO), and the Hamilton and District Society of Optometrists. He is also an affiliate doctor at TLC Laser Eye Centres.

Add Me, for example, lets you take a photo of your loved one in front of a subject, like the Eiffel Tower, and then swap places so that they can take a picture of you doing the same—the camera will superimpose the images to make it look like you stood next to each other naturally. No need to risk handing your phone to a stranger to take a pic. The entire Panorama mode in the Pixel 9 has been rebuilt too. It's not something you'll use often, but when you do, it's probably when you're at an important vista. That's why Reynolds says the team focused on bringing it up to speed with more recent camera advancements, utilizing the entire HDR+ Night Sight image processing algorithm for low-light improvements and better stitching quality.

Optical coherence tomography, or OCT for short, is sometimes referred to as a “3D” or “digital” eye exam. That’s because OCT involves taking 3D, digital images of your eye. Specifically, OCT takes a cross-sectional image of your retina, the light-sensitive part of your eye.

Memories are the underlying theme driving many of the new features from Google's camera team. Earlier in the day, I sat down with Isaac Reynolds, the group product manager for the Pixel Camera, which he's been a part of since 2015 with the launch of the first Pixel phone. Nearing his 10th anniversary, Reynolds says he's probably “more enthused than many others” about mobile photography, believing there's still so much space to advance cameras. “I see the memories people can't capture because of technical limitations.”

“I don’t think anything we have today is going anywhere. I do think we are going to make a lot of things a lot easier for folks, and that’s going to be fantastic,” he says. “Cause then they can spend doing other things, making more memories, instead of fighting to create the memories they thought they already had or didn’t match up to how they remembered it and now they’re frustrated and sad. I think we’re going to have a lot more happy folks making memories more easily.”

OCT works similarly to an ultrasound. It provides real-time images of your eye’s internal structures like an ultrasound, but OCT uses light waves instead of sound waves. These light waves illuminate and scan your retina, giving your optometrist a detailed view. So detailed, that your optometrist can evaluate your retina at a near-cellular resolution.

Age-related macular degeneration (AMD) is one disease OCT can help diagnose, often earlier than other methods. AMD affects the macula, which is the central part of the retina.

We met at a small photo studio on the second floor of a building in Brooklyn near McCarren Park. It's not the kind of space you'd expect to be bankrolled by one of the wealthiest companies on Earth. The studio is small, with seamless paper backdrops against one wall and a mountain of photo equipment on the other end of the room. Koenigsberger says his team put it together in 2020 during the pandemic and have held onto it since.

We understand that life is hectic. We want to help make it a little simpler, which is why our centrally-located practice offers extended hours on Saturdays. We’re also happy to directly bill most major insurance companies on your behalf. And on top of all that? We’ve got plenty of free parking. Stoney Creek Eye Care & Eyewear Boutique will always do whatever we can to make your life a little easier, located in the Health Science Building.

“Ultimately, this is going to be someone's memory," Koenigsberger says. "It's going to be their experience with their family; it's going to be that trip with their best friend—as close as we can get to recreating those experiences when we're testing, I think the more reliably we're going to get people something that they're happy with.”

Florian Koenigsberger and his team have been acting on this kind of feedback to continually tweak image processing algorithms ever since Real Tone debuted in the Pixel 6 three years ago. He’s Google’s image equity lead and the person who spearheaded the project. I got a chance to peek behind the studio curtain to see the testing Google does to refine these imaging algorithms every year—Real Tone in the latest Pixel 9 series supposedly offers some of the most notable improvements across the board since its launch.

OCT testing gives your optometrist an in-depth look into your eyes without feeling in-depth. The process is quick and painless, with nothing touching your actual eye. It’s no more hassle than getting a school photo done, except in the case of OCT, the photo is of your retina.

Because OCT gives such detailed images of the retina and macula, it can help diagnose a variety of other conditions, including:

This year's Pixel 9 series is also the first time that Google's skin tone classifier fully aligns with the Monk Skin Tone Scale, a 10-shade scale released to the public that represents a broad range of skin tones, meant to help with all kinds of uses from computational photography to health care. Koenigsberger says this change allows for much more fine-tuned color adjustments.

Another new change is also auto-white balance segmentation, and this process allows for separate auto-white balance exposures for people in the picture from their background. Before, you may have noticed some color seeping in from a setting, like blue skies producing a cooler tone to the skin. This new system helps “people stay the way that they should look, separate from the background,” Koenigsberger says.

Dr. Bahoshy began practicing at Stoney Creek Eye Care (formerly known as Dueck Optometry) in 2001. In October 2017, Dr. Bahoshy became the clinic’s new owner, continuing the commitment of serving Stoney Creek and the surrounding community.

A truly complete eye care experience includes the best eyewear the world has to offer. Our Boutique is well-stocked with globally-recognized brands like Dior, Ray-Ban, Kate Spade, Fossil, and much more.

Two years ago, I interviewed Ramesh Raskar, associate professor at MIT Media Lab, for a video on the advancements in smartphone photography, and he talked about how one day we’ll have camera phones that let you change a cloudy day in Paris to a sunny one. That day seems to pretty much be here. I reached back out to Raskar, who happened to be in Paris for the Olympics, and he remarked how he has barely seen anyone with a professional camera in the audiences (barring sports photographers, of course).

As a photographer, that’s a terrifying future to imagine. If it’s any consolation, Reynolds doesn’t think photography is dead.

As part of his optometry training, Dr. Bahoshy completed an externship at the prestigious Omni Eye Institute in Baltimore, gaining extensive experience in diagnosing and managing ocular health conditions. He worked alongside a pediatric ophthalmologist at their satellite location in White Marsh.

“One could argue that the best photos are the ones that don't capture what we see with our eyes,” Raskar says. “The photos that we like are extreme zoom, very shallow depth of field, macro photos, capturing motion in bizarre ways, light trails. Even in the world of photography we have moved away from photos that would have been seen by a natural eye. That evolution will continue, and photography will be less and less about what the eye can see.”

Diabetic retinopathy causes damage to the retina, specifically to the blood vessels. OCT imaging shows these damaged or abnormal blood vessels, allowing for diagnosis.

If you’re undergoing dilation, your optometrist will put eye drops into your eyes that cause your pupils to expand, or dilate. Most patients find dilation painless, although some light sensitivity is to be expected. You’ll still be able to drive yourself home from the exam, but make sure you bring a pair of sunglasses to help with the light sensitivity.

© 2024 Condé Nast. All rights reserved. WIRED may earn a portion of sales from products that are purchased through our site as part of our Affiliate Partnerships with retailers. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of Condé Nast. Ad Choices

To Reynolds and the broader Pixel Camera team, it's not necessarily the photo that's important, but your memory. If you want to fudge with the image by altering the color of the sky to be sunset or use the new Autoframe feature to recompose the image so that it's more striking, then that's OK.