Why don’t cameras use smartphone technology?

It’s a question many photographers, including myself, have been asking for years. Why don’t mirrorless and DSLR cameras utilize smartphone technology and apps?

My friend Mary Wade, using a co-worker’s ring light, had photographed portraits of her fellow employees using both an older DSLR and her new Google Pixel smartphone. “The photos that I took with my phone looked a lot better,” she noted. 

After she found that much of that is due to how newer camera phone tech processes the images, she thought, “Sign me up for auto processing!” She’s busy, after all. She writes and does a billion other things at the office.

Could computational photography take a single exposure image such as this Milky Way, and applies keystoning corrections to straighten the building, add noise reduction without ruining the pinpoints of the stars, color correct, apply white balance and more automatically and instantaneously? Would it allow you to “stack” photos and add in a low ISO foreground to provide an absurdly clean image? And could it do this all while leveraging full-frame sensors and high-quality lens?

Four benefits we might get with smartphone processing technology applied to cameras

Cameras on smartphones can take some astonishingly great photos. Given that they use a considerably smaller sensor, just think what images we could take if this technology were applied to much larger, more detailed sensors found in mirrorless and DSLR cameras. Just think what it might look like if we applied that to all that amazing glass. Computational photography would no longer have to battle the physics of smaller sensors and tiny lenses.

1. Instant image processing similar to smartphones

Many of us, like Mary, often like the way modern smartphones automatically process photos. Smartphones, after all, automatically adjust white balance, adjust color, automatically sharpen, create high-dynamic photos and more, using computational photography. It can reduce noise or brighten certain aspects of an image automatically. And it can do it at lightning speed.

For real estate or sports photographers, this could also mean being able to send images to clients faster than ever. Photographers could also send their images to printers much more efficiently as well. 

Some photographers, including us night photographers, might not want the camera to process our photos automatically. Or perhaps we might want it to, but also leave the original copy intact so we can process it on our own and compare. Cameras could offer these choices.

iPhone SE 2020. This was a quick photo taken for selling the photos. One person wrote in simply to tell me that it was the most beautiful photo of a vehicle she had ever seen in the used ads. Applying this instant processing to cameras with much larger sensors could benefit us all.

2. Bokeh 

Portrait Mode in iPhone or Android, creating bokeh, might also be a great application. Being able to use machine learning to automatically focus on eyes (yes, I know many mirrorless cameras already do this) while creating a creamy bokeh might be good. 

iPhone SE 2020 — not the highest end camera phone by a long shot. However, simply by selecting Portrait Mode and black and white, I was instantly able to create this selfie, which uses the more inferior of the two cameras on the phone, and send this to our families while we were at the beach. What could this technology do in a camera with a much better lens and larger sensor?

3. Top Shot

Mirrorless cameras could incorporate technology such as Google’s Top Shot. For instance, You might take a photo where one person blinks. Top Shot to the rescue. Top Shot will work to select the best shots through utilizing a three-second video and on-device machine learning, taking into account open eyes or other factors such as smiling or whether the subjects are looking at the camera, and create a photo for you.

4. Capturing life experiences in three dimensions

iPhone has already rolled out a LiDAR scanner and app. This allows you to take night mode portraits, video-based Portrait Mode, and low-light bokeh to new heights. But coupled with machine learning, it promises more, such as 3D photography, augmented reality, and of course, continually improving bokeh for day portraits.

The idea of capturing your child’s first birthday or your wedding using LiDAR to create a three-dimensional documentation is intriguing. Much of the issue with LiDAR so far has been lack of resolution. However, quality lenses and large sensors may offset this.

5. Combining elements

Perhaps machine learning might be applied toward combining qualities not physically possible in a lens. Could we have a weird 400mm fisheye? Or a 180-degree wide-angle that blurs like a Lensbaby? 

Using smartphone OS and apps on cameras

A rather fun if crude re-imagining of a full-sensor camera with interchangeable lens coupled with a large smartphone screen and technology.

I would love to see my cameras with larger screens and sporting operating systems such as the ones found in our smartphones. Wouldn’t it be particularly powerful if a camera had the ability to use apps such as Clear Outside, PhotoPills or apps that offered more specific controls over the camera, such as exposure ramping (gradually changing your camera’s settings) for time-lapses? The mount just reels at the amount of control, information and ease of operation you could have.

Going further, one could also have photo editing apps in-camera. One could use Photoshop Express, Lightroom, Snapseed or many others.

Two cameras that may bring us closer to smartphone-like technology

1. Alice Camera

Alice Camera, currently in development, shows promise. This device promises the experience of a smartphone coupled with the capability of a high-end mirrorless camera. Alice is an AI-accelerated computational camera with a high-resolution four-thirds sensor and interchangeable lens. You may instantly stream and post in 4K to Twitch, YouTube, TikTok, Instagram or Facebook easily.

Unlike previous smartphone attachments such as lenses, this is a full slim-lined camera where you slide the smartphone on so both are integrated. It feels more like the smartphone is attached to the camera, not the other way around. 

2. Yongnuo YN455

Yongnuo is perhaps best known in the United States for producing inexpensive flashes, lenses and other accessories. But they did begin manufacturing cameras incorporating a smartphone with traditional camera functions, running an older version of Android. 

Now, Yongnuo has submitted a patent for a modular mirrorless camera. And it’s also announced a new camera, the YN455. Like its predecessor, the not-fully-realized YN450, the YN455 incorporates an Android operating system. Yongnuo says that it will have a micro four-thirds sensor, cellular 4G and Wi-Fi. And yes, you guessed it, that means that like Alice Camera, you may also share straight to social media easily. 

There is no news on when this will be released or whether it will be available outside China. If it’s as good as it seems, you might want to begin making friends with someone in China now so you can get your mitts on this.

Security technology in cameras

 Fingerprint sensor photo by George Prentzas on Unsplash.

Cameras could also incorporate smartphone technology in other ways. 

Canon has already patented a fingerprint sensor on not only the camera but also the lens. What security implications could this provide?

Beyond security, the sensor might also be able to instantly load custom presets for particular photographers. This obviously has some downsides, such as identity failure or slowing down someone from using the camera. But perhaps this sort of technology could be activated only during certain times.

Tracking your camera

If a camera were running iOS or Android, perhaps we could also track cameras. This could be valuable if the camera is lost, stolen, or left in the last Lyft car we took. 

I once came across a night photographer in Mesquite Dunes in Death Valley National Park. “Have you seen a camera anywhere?” He continued frantically searching.

Now, if you’ve been to Mesquite Dunes, you know that it’s quite possible for miles of sand dunes to look similar after a while. This would be exponentially compounded at night. But if you could use something similar to a Find Your Phone app, perhaps you could greatly narrow down the location. Perhaps you could make it emit a sound. After all, most cameras already have GPS devices on board. 

What’s the holdup?

Why haven’t the largest camera manufacturers, such as Sony, Nikon, Canon and others not fully embraced the sort of technology in smartphones that seem intuitive to just about everyone? Why is this left to smaller companies such as Alice Camera and Yongnuo?

Major camera manufacturers seem to mostly produce incrementally better cameras with each generation. But they seem reluctant to incorporate smartphone technology. Rarely if ever do we see operating systems with the ability to use apps. With sales of mirrorless and especially DSLRs dwindling, this makes their decision all the more puzzling.

What smartphone technology would you love to see on a camera?

VISIT ME, VISIT ME!

MY WEBSITE:
Head on over to the Ken Lee Photography website to purchase books or look at night photography and long exposure photos.  My latest book, “Abandoned Southern California: The Slowing of Time” is available there and Amazon, Barnes and Noble, Target, Booktopia, Books A Million, IBS, and Aladin. If you enjoy the book, please leave a nice review.

SOCIAL MEDIA:
Ken Lee Photography Facebook Page (poke your head in, say hi, and “like” the page if you would, uh, like)
Instagram

PODCAST:
Behind the Shot video podcast – interview February 2020

VIDEO INTERVIEW:
Conversation about night photography and my book with Lance Keimig of National Park At Night

ARTICLES:
A Photographer Captures Haunting Nighttime Images of Abandoned Buildings, Planes, and Cars in the American Southwest – Business Insider by Erin McDowell
A Photographer Explores Southern California’s Desert Ruins – Los Angeles Magazine article by Chris Nichols

 

 

Advertisement

Photo Tip of the Month – Fill Light To Reduce Contrast in the Mid-Day Sun

You’d be surprised how many people will ask, “Why are you using a flash? There’s plenty of light!”  Here’s how flash can help your mid-day photos.

A photo of a Wild West wagon, using a fill light to minimize the harsh contrast of the mid-day sun. Nikon D90, 18-200mm VR Nikkor lens, 18mm ISO 200 F/6.3.

You can’t always shoot photos during the “golden hours” (early morning, just before sunset).  And you may not always want this. Sometimes, you want to capture the look of something at mid-day.  But as anyone who has shot knows, this can create harsh light and harsh contrasts, particularly with subjects that are in the shade, as shown below:

Our Wild West wagon with no fill light as an example of how mid-day sun can create harsh light and harsh contrasts in photos, particularly with subjects that are partially in the shade. Compare this with the other photo which uses the fill light.

So, what to do?  Use a flash as a fill light.

For this photo, I used a Nikon SB-600 Speedlight Flash in wireless mode.  I placed it down on the ground, just out of frame on the right side, facing up at the wagon, with a Sto-Fen Omni-Bounce OM-600 Flash Diffuser Unit to diffuse the light.  I like to use off-camera flash because I have more control over what area of the subject my flash lights (and if shooting portraits, it’s a great way to avoid getting demonic red eyes!).  Here’s another look at the photo using fill flash:

Have another look at the photo of a Wild West wagon, using a fill light to minimize the harsh contrast of the mid-day sun.  Nikon D90, 18-200mm VR Nikkor lens, 18mm ISO 200 F/6.3.

Equipment:  Nikon D90, Nikon 18-200mm VR II Nikkor Telephoto Zoom Lens, Nikon SB-600 Speedlight, Sto-Fen Flash Diffuser.

 

Photo Tip of the Month – 5 Reasons Why Compact Cameras Rule

Five Reasons Why Compact Cameras Rule
I own a Leica DLux 4, although there’s a Panasonic equivalent, the Lumix DMC-LX3, which is considerably cheaper and has the same body and lens.  This camera does quite well in low light situations for a compact camera.  There’s also four thirds and interchangeable lens cameras, other high quality compacts, such as the Canon G11 or G12, and iPhones or other phone cameras which can take quality photos.  I always prefer to bring a compact camera when i travel.  And a lot of professional photographers will bring a compact camera with them when they are on assignment.  Here’s five reasons why:

1.  It Ain’t a Great Photo If You Don’t Take It.  If you don’t have your camera with you, you’re not going to get the shot.  But with a small camera that can fit in your pocket, you can always have it with you for those unexpected fantastic opportunities.

2.  Mobile and Spontaneous.  Clubs?  Hiking?  Street Photography?  Concerts?  It’s always with you.  Take it out, start shooting instantly, and even upload it to your Facebook page if your camera allows you to do so.

3.  Make People At Ease With Portraits.  People are often more at ease with smaller cameras than large SLRs.  They’ll relax more, perceiving the smaller camera as less “formal”.  And with most cameras being smaller than DSLRs, that can help quite a bit in getting your subject comfortable with your photography.

4.  “Macro” Photography.  A lot of smaller cameras can also focus on objects much closer.  This can be a lot of fun when doing quick photos of…well, just about anything, whether it’s flowers, animals, or every day objects, bringing a new perspective that your SLR may not be able to do unless it has macro lens.

5.  Safety.  With a small pocket camera, you are far less likely to attract attention.  You’re far less of a target for theft.  This quite possibly can save your life.

Good portraits can be taken with modest or small cameras, such as the one with a Brazilian girl, taken with a Leica D-Lux 4 (the same as a Panasonic DMC-LX3 – see link below) compact camera.  I can keep this in my pocket, perfect for the photographer on the go.

Paulinho of the Pandeiro, Brazil. This photo illustrates a close-up low-light photograph that many high-quality compact cameras can achieve. Photographed with the Leica D-Lux 4 (the same as a Panasonic DMC-LX3 – see link below), which I kept in my pocket except for occasional photos, increasing my safety and people’s comfort level…perfect for the photographer on the go.

Equipment:  Nikon D90, 18-200mm VR Nikkor lens

Photo Link: Nikon D4’s Amazing Low Light Capabilities And Other Features

I’ve been receiving some information about the new flagship Nikon camera, the D4. here’s a link to the manufacturer’s website.  Every once in a while, I’ll link to something that may be of interest, and today, that’s the D4.

King of Low Light
One of the specs I’m most interested in is its low-light capability, with an ISO Range  of100-12,800 (extendable from 50 – 204,800).  I’m going to repeat that again.  204,800.  One can only hope that light sensitivity like this will eventually filter its way down to more affordable cameras for the rest of us.  In my opinion, this is one area where Nikon shines.  I think Canon offers more “bang for the buck”, but when Nikon is offering low light sensitivity like this, it’s difficult to look elsewhere for this price range.

Additionally, the D4 offers HDR, combining multiple images in-camera to produce images with increased dynamic range.  Obviously, other cameras that are considerably cheaper do this too, but something tells me that this’ll do it really darn well.

The D4 also has a giant new higher-resolution 16.2 megapixel CMOS sensor, but has also added a 91,000 pixel RGB 3D Color Matrix metering sensor that senses brightness and color, and supposedly interprets this with increased accuracy in color reproduction and balanced exposure.  And it adds face recognition, an appealing feature that is on many consumer cameras, but has often been left off cameras designed for professional use.

1080p HD Video
Probably the biggest, most obvious change is that Nikon has no doubt been noticing how well the  5D Mark II has been doing in the professional video market and wants to step it up.  Coupled with its fantastic low-light capabilities, The D4 captures HD 1080p video at various frame rates, easily suitable for broadcast quality video, and is capable of streaming the video out its HDMI port.

Field Monitor and Remote Capable Through iPad
Of some interest as well is that Nikon reports that the D4 is also iPhone/iPad compatible.  But what does this mean?  You can control the D4 via a web browser through your iPhone or iPad.  Nikon uses an HTTP protocol, meaning that with a Wifi or other internet connection, you can control the D4 remotely.  This could be handy for photographers or filmmakers who, say, have the camera attached to the top of a basketball backboard for sporting events, attached to a moving vehicle, or perched on top of a tree or crane.

The Sucky Part
I’ve seen on several reviews that due to the increased functionality of the camera, the battery life is lower.  However, Nikon has said that they are coming out with a new battery that promises better battery life.

Overall, this sure makes me wish I had US$6000.

Equipment:  I currently use a Nikon D90, 18-200mm VR Nikkor lens, and a 50mm f/1.4 lens.