Skip to main content

Human Screenome Project wants you to share everything you do on your smartphone

Roo Lewis/Getty Images

You’ve almost certainly seen them on YouTube. “Noah takes a photo of himself every day for 20 years” (5 million views.) “Portrait of Lotte, 0 to 20 years” (10.9 million views.) “Age 12 to married — I took a photo every day” (an astonishing 110 million views.) Heck, even Homer Simpson and Family Guy’s Peter Griffin have parodied the format. In an age of selfies and ubiquitous smartphone cameras, this increasingly popular genre of time-lapse videos depicting the aging process lets people self-chronicle their lived experiences in a quintessentially modern way that would have been all but impossible just a couple of decades ago.

But what if the bigger story wasn’t some YouTube star’s changing facial features, but rather the fact that tens of millions of us would dedicate minutes of our day to watching them? And, maybe after that, tweeted out a link to the video we’d just watched. Or sent it to a buddy on WhatsApp. Or fired up the camera app on our own smartphone and started making our own version. Or just forgot about what we’d just watched entirely, and played a quick game on Mario Kart Tour.

Child Using Smartphone
Image used with permission by copyright holder

In a world in which we live digitally, the way we consume media on our screens (and, particularly, on our smartphones) may just turn out to be the most profound way of documenting life in 2020. At least, that’s the idea of an ambitious new initiative called the Human Screenome Project. Created by researchers at Stanford and Penn State University, it’s a new mass data collection exercise that asks users to agree to share information about every single thing they do on their smartphones.

Recommended Videos

Special software developed by the project’s creators will take screenshots of these mobile devices every five seconds they’re active, encrypt it, send it off to a research server, and then use artificial intelligence algorithms to analyze exactly what it is that’s being looked at. In the process, the researchers want to create a multidimensional map of people’s changing digital lives in the twenty-first century; providing a moment-by-moment look at changes over the course of days, weeks, months, and potentially even years and decades.

“The digital media environment has [advanced] so much in the last few years,” Nilam Ram, professor of human development and psychology at Penn State University, told Digital Trends. “We don’t really have a good idea of how people are using their devices, and what it is that they’re being exposed to. Typically, research studies about screen time will rely on self-reports about how long people engaged with social media over the past week. That’s a really complicated question for people to answer. The evidence suggests that people are over- or underestimating their own engagement by as much as a few hours.”

A resource for researchers everywhere

According to Ram, the project traces back seven years to a chance meeting between himself and Byron Reeves, a professor of communication at Stanford. Reeves was interested in media and its effects on people. Ram was interested in behavioral time series data; a type of behavioral analytics that works with regular data points gathered in chronological order. This can be used to study — and predict — things about the behavior of individuals.

At first, the pair set out to explore multitasking. They developed software that they could use to see how rapidly student participants switched between tasks when they are working. They discovered that they would switch windows approximately every 20 seconds. “That was faster than anyone at that time thought anyone was switching from task to task,” Ram said. “From there, we developed software to do it on a smartphone.”

A Screenome Sample

They figured that this would be a natural extension of their work with multitasking. But when the initial flow of data, from a small group of students, came in, they realized they had tapped a far deeper well than they thought. “Once we started watching the time-lapse footage of what people were actually doing on their phone, we realized that, wow, there are so many different types of human behaviors that are expressed here,” Ram said. “That could be engagement with politics, mental health issues, social media issues, interpersonal relations, climate change. We can see things like the gender distribution of faces that people look at on their phones, the racial distribution of those faces — there’s so much richness in it.”

If this sounds like it’s too much for one pair of researchers to look at, you’d be absolutely correct. The hope is that the Human Screenome Project — whose name is a nod to the previous Human Genome Project — will create a vast sharable database of information that will be available for other researchers to explore as well. This will be part-ongoing user survey (albeit without users having to actively answer questions) and part-historical artifact, like a digital Mass Observation Project. The potential value of such an archive could be immense. Some researchers might use it to track the rise and fall of memes as they appear, flourish, and disappear into the cybernetic ether. Students of design could use it to look at how changing app user interfaces reflect transitions in that particular field. Others may use it, alongside cross-referenced information, to study the potential health impacts of social media. Or how screen time impacts concentration.

“The idea of the Human Genome Project was that, if we could map the human genome, it would change the way we approach disease and the treatment of disease,” Ram said. “I think it did that. Here, we’re in some ways trying to take the same kind of theoretical leap, saying that if we can map out the Human Screenome it will change the way we think about digital media and how it’s affecting people.”

It’s like mass surveillance but… good?

But is a project like this workable? The same thing that makes it so tantalizing from a research point of view is what also raises challenges. Simply put, as Apple co-founder and former CEO Steve Jobs predicted way back in 2007, the smartphone has become a consolidation of all the separate devices we once carried around. It is our laptop, our personal organizer, our portable music player, our GPS system, and more.

A group of people using smartphones
Image used with permission by copyright holder

With the requirement of physical user interaction and millions of available apps, a smartphone is a far more dynamic media environment than its antecedent: the living room television with its choice of a handful of channels to pick from. As windows into our interests go, smartphones are the epitome of what media theorist Marshall “the medium is the message” McLuhan would have called “extension of ourselves.” However, that makes them personal in a way that few other devices are. Allowing researchers to see everything you do on your smartphone will, for some users, simply be a step too far.

Still, Ram is confident this will not hold true for everyone. “Generally we find in our conversations with participants that they are well aware that their data is being collected by the big data companies on a very regular basis,” he said. “It’s being used in ways that they have no control over. They seem aware of that, and excited about the possibility that those data might instead be used for research purposes to understand human behavior.”

As of now, the Stanford Screenomics Lab has collected over 30 million data points from more than 600 participants. While it has yet to open up its platform to whoever wants to get involved, Ram hopes the number of users could eventually scale this number to far more epic proportions, with multi-year contributions from users.

And what about when smartphones finally give way to some other dominant technology? “[This is something that] could go on forever,” Ram said. “[That will mean that it has to] transform in different ways as screens move from being separate devices to ones that are embedded somehow, whether it’s a chip or a Google Glass-style evolution. We want to evolve our data collection paradigm along with the emergence of those technologies.”

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Juiced Bikes offers 20% off on all e-bikes amid signs of bankruptcy
Juiced Bikes Scrambler ebike

A “20% off sitewide” banner on top of a company’s website should normally be cause for glee among customers. Except if you’re a fan of that company’s products and its executives remain silent amid mounting signs that said company might be on the brink of bankruptcy.That’s what’s happening with Juiced Bikes, the San Diego-based maker of e-bikes.According to numerous customer reports, Juiced Bikes has completely stopped responding to customer inquiries for some time, while its website is out of stock on all products. There are also numerous testimonies of layoffs at the company.Even more worrying signs are also piling up: The company’s assets, including its existing inventory of products, is appearing as listed for sale on an auction website used by companies that go out of business.In addition, a court case has been filed in New York against parent company Juiced Inc. and Juiced Bike founder Tora Harris, according to Trellis, a state trial court legal research platform.Founded in 2009 by Harris, a U.S. high-jump Olympian, Juiced Bikes was one of the early pioneers of the direct-to-consumer e-bike brands in the U.S. market.The company’s e-bikes developed a loyal fandom through the years. Last year, Digital Trends named the Juiced Bikes Scorpion X2 as the best moped-style e-bike for 2023, citing its versatility, rich feature set, and performance.The company has so far stayed silent amid all the reports. But should its bankruptcy be confirmed, it could legitimately be attributed to the post-pandemic whiplash experienced by the e-bike industry over the past few years. The Covid-19 pandemic had led to a huge spike in demand for e-bikes just as supply chains became heavily constrained. This led to a ramp-up of e-bike production to match the high demand. But when consumer demand dropped after the pandemic, e-bike makers were left with large stock surpluses.The good news is that the downturn phase might soon be over just as the industry is experiencing a wave of mergers and acquisitions, according to a report by Houlihan Lokey.This may mean that even if Juiced Bikes is indeed going under, the brand and its products might find a buyer and show up again on streets and trails.

Read more
Volkswagen plans 8 new affordable EVs by 2027, report says
volkswagen affordable evs 2027 id 2all

Back in the early 1970s, when soaring oil prices stifled consumer demand for gas-powered vehicles, Volkswagen took a bet on a battery system that would power its first-ever electric concept vehicle, the Elektro Bus.
Now that the German automaker is facing a huge slump in sales in Europe and China, it’s again turning to affordable electric vehicles to save the day.Volkswagen brand chief Thomas Schaefer told German media that the company plans to bring eight new affordable EVs to market by 2027."We have to produce our vehicles profitably and put them on the road at affordable prices," he is quoted as saying.
One of the models will be the ID.2all hatchback, the development of which is currently being expedited to 36 months from its previous 50-month schedule. Last year, VW unveiled the ID.2all concept, promising to give it a price tag of under 25,000 euros ($27,000) for its planned release in 2025.VW CEO Larry Blume has also hinted at a sub-$22,000 EV to be released after 2025.It’s unclear which models would reach U.S. shores. Last year, VW America said it planned to release an under-$35,000 EV in the U.S. by 2027.The price of batteries is one of the main hurdles to reduced EV’s production costs and lower sale prices. VW is developing its own unified battery cell in several European plants, as well as one plant in Ontario, Canada.But in order for would-be U.S. buyers to obtain the Inflation Reduction Act's $7,500 tax credit on the purchase of an EV, the vehicle and its components, including the battery, must be produced at least in part domestically.VW already has a plant in Chattanooga, Tennesse, and is planning a new plant in South Carolina. But it’s unclear whether its new unified battery cells would be built or assembled there.

Read more
Nissan launches charging network, gives Ariya access to Tesla SuperChargers
nissan charging ariya superchargers at station

Nissan just launched a charging network that gives owners of its EVs access to 90,000 charging stations on the Electrify America, Shell Recharge, ChargePoint and EVgo networks, all via the MyNissan app.It doesn’t stop there: Later this year, Nissan Ariya vehicles will be getting a North American Charging Standard (NACS) adapter, also known as the Tesla plug. And in 2025, Nissan will be offering electric vehicles (EVs) with a NACS port, giving access to Tesla’s SuperCharger network in the U.S. and Canada.Starting in November, Nissan EV drivers can use their MyNissan app to find charging stations, see charger availability in real time, and pay for charging with a payment method set up in the app.The Nissan Leaf, however, won’t have access to the functionality since the EV’s charging connector is not compatible. Leaf owners can still find charging stations through the NissanConnectEV and Services app.Meanwhile, the Nissan Ariya, and most EVs sold in the U.S., have a Combined Charging System Combo 1 (CCS1) port, which allows access to the Tesla SuperCharger network via an adapter.Nissan is joining the ever-growing list of automakers to adopt NACS. With adapters, EVs made by General Motors, Ford, Rivian, Honda and Volvo can already access the SuperCharger network. Kia, Hyundai, Toyota, BMW, Volkswagen, and Jaguar have also signed agreements to allow access in 2025.
Nissan has not revealed whether the adapter for the Ariya will be free or come at a cost. Some companies, such as Ford, Rivian and Kia, have provided adapters for free.
With its new Nissan Energy Charge Network and access to NACS, Nissan is pretty much covering all the bases for its EV drivers in need of charging up. ChargePoint has the largest EV charging network in the U.S., with over 38,500 stations and 70,000 charging ports at the end of July. Tesla's charging network is the second largest, though not all of its charging stations are part of the SuperCharger network.

Read more