We unleashed Facebook and Instagram’s algorithms on blank accounts. They served up sexism and misogyny | Meta

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

We unleashed

This is the hidden content, please

• Sign In
• or
• Sign Up

and

This is the hidden content, please

• Sign In
• or
• Sign Up

’s algorithms on blank accounts. They served up sexism and misogyny | Meta

How do the algorithms of

This is the hidden content, please

• Sign In
• or
• Sign Up

and

This is the hidden content, please

• Sign In
• or
• Sign Up

affect what you see in your news feed? To find out, Guardian Australia unleashed them on a completely blank smartphone linked to a ******* email address.

Three months later, without any input, they were riddled with sexist and misogynistic content.

The explore page of a ******

This is the hidden content, please

• Sign In
• or
• Sign Up

account set up by Guardian Australia in April. Photograph:

This is the hidden content, please

• Sign In
• or
• Sign Up

The John Doe profiles were set up in April as generic 24-year-old males.

This is the hidden content, please

• Sign In
• or
• Sign Up

was able to gather some other information, such as the phone’s type and its location in Melbourne, but we opted out of ad tracking so it could not tell what we were doing outside of the app.

This is the hidden content, please

• Sign In
• or
• Sign Up

had little to rely upon in the absence of any likes, comments or accounts added as friends. Meanwhile,

This is the hidden content, please

• Sign In
• or
• Sign Up

makes users follow at least five accounts to start, so we chose the popular recommended accounts, including the prime minister and Bec Judd.

Meta says its algorithms rank content according to what people are interested in, but we wanted to find out where it would take us in the absence of such inputs. We scrolled through the feed every couple of weeks to check what was being served up.

What did we see?

Initially

This is the hidden content, please

• Sign In
• or
• Sign Up

served up jokes from The Office and other sitcom-related memes alongside posts from 7 News, Daily Mail and Ladbible. A day later it began showing Star Wars memes and gym or “dudebro”-style content.

By day three, “trad *********”-type memes began appearing and the feed veered into more sexist content.

Three months later, The Office, Star Wars, and now The Boys memes continue to punctuate the feed, now interspersed with highly sexist and misogynistic images that have have appeared in the feed without any input from the user.

On

This is the hidden content, please

• Sign In
• or
• Sign Up

, while the explore page has filled with scantily-clad women, the feed is largely innocuous, mostly recommending Melbourne-related content and foodie influencers.

An example of a misogynistic meme pushed into the feed of an otherwise blank

This is the hidden content, please

• Sign In
• or
• Sign Up

account. Photograph:

This is the hidden content, please

• Sign In
• or
• Sign Up

Meta was approached for comment but refused to respond on the record.

In its submission to the federal parliament’s social media inquiry, Meta says it uses “a range of different algorithms” to help rank content shown in feeds on

This is the hidden content, please

• Sign In
• or
• Sign Up

and

This is the hidden content, please

• Sign In
• or
• Sign Up

, with some helping “us understand what content is most meaningful to people so we can order it accordingly in their feeds”.

The company said that what people see is “heavily influenced by their own choices and actions” and “each person’s feed is highly personalised and specific to them”.

“Our ranking system personalises the content for over a billion people and aims to show each of them content we hope is most valuable and meaningful, every time they come to

This is the hidden content, please

• Sign In
• or
• Sign Up

or

This is the hidden content, please

• Sign In
• or
• Sign Up

.”

The company says it assesses posts for signals such as who posted it, how popular it is, the type of device being used, and then uses ranking algorithms to predict how likely the post is to be relevant and meaningful to a person.

“The goal is to make sure people see what they will find most meaningful – not to keep people glued to their smartphone for hours on end.”

It’s kind of degrading for men for the algorithm to make this assumption about their interests

Dr Stephanie Wescott

Meta said it also uses the ranking to assess whether a post is likely to be problematic, but does not violate community standards. That includes clickbait, unoriginal news stories and posts fact-checked as false.

It’s ‘baked into the model’

Guardian Australia’s findings align with

This is the hidden content, please

• Sign In
• or
• Sign Up

in Australia and Ireland on

This is the hidden content, please

• Sign In
• or
• Sign Up

and TikTok, in which multiple accounts set up as young men and teens were funnelled to “Manosphere” content.

Dr Stephanie Wescott, a lecturer in humanities and social sciences at Monash University,

This is the hidden content, please

• Sign In
• or
• Sign Up

like Andrew Tate on school-aged boys and told Guardian Australia our investigation results for

This is the hidden content, please

• Sign In
• or
• Sign Up

were not surprising.

“Based on the research I’m doing and also what we know [from other research] this is what we know the algorithm will provide and serve up to young men, based on what it assumed will capture their interest,” she said.

skip past newsletter promotion

Sign up to Afternoon Update

Our *********** afternoon update breaks down the key stories of the day, telling you what’s happening and why it matters

Privacy Notice: Newsletters may contain info about charities, online ads, and content funded by outside parties. For more information see our Privacy Policy. We use

This is the hidden content, please

• Sign In
• or
• Sign Up

reCaptcha to protect our website and the

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

and

This is the hidden content, please

• Sign In
• or
• Sign Up

apply.

after newsletter promotion

“It’s kind of degrading for men for the algorithm to make this assumption about their interests … [that] you’re going to like these sort of misogynistic memes.”

Nicholas Carah, an associate professor in digital media at the University of Queensland, said the experiment showed how “baked into the model” serving up such content to young men is on

This is the hidden content, please

• Sign In
• or
• Sign Up

.

A different meme automatically served to a blank

This is the hidden content, please

• Sign In
• or
• Sign Up

account’s feed. Photograph:

This is the hidden content, please

• Sign In
• or
• Sign Up

“We have to think seriously about the informational environment young men are immersed in and the problem with platforms is they’ve made that information environment completely dark and ephemeral to anyone but those young men,” he said.

“There has to be some kind of public imperative here where platforms help civil society, journalists, researchers, regulators, whoever, observe what these informational flows look like so that we can have some kind of public understanding, public scrutiny, and public debate about them.”

Wescott said platforms need to answer questions on how the algorithms work because currently they are unaccountable.

“They’re beyond reproach and they don’t seem to be willing to put any sort of alterations or restrictions on their algorithm.”

‘River of complete garbage’

The quality of what is served on

This is the hidden content, please

• Sign In
• or
• Sign Up

to every user in Australia had declined in the past few years, Carah says, coinciding with Meta’s decision to deprioritise news as it gears up to ****** against paying media companies under Australia’s news media bargaining code.

“Australians are now immersed in this river of complete garbage on

This is the hidden content, please

• Sign In
• or
• Sign Up

. I’m kind of curious, does this mean we’ll all just keep scrolling through this *****? Or is

This is the hidden content, please

• Sign In
• or
• Sign Up

actually undermining their own product here?”

Wescott says it’s important people are educated to critically assess what is being served to them on social media and not to accept it as a reflection of reality. She praises the federal government’s

This is the hidden content, please

• Sign In
• or
• Sign Up

, which includes an “Algorithm of Disrespect” interactive depicting what a young man may encounter on social media.

The federal government has also funded a $3.5m three-year trial to counteract the harmful impacts of social media messaging targeting young men and boys.

The communications minister, Michelle Rowland, says digital platforms need to do more to ensure that community standards are respected online as well as offline.

“We’re seeing misogynistic content pushed to young people through algorithms and recommender systems on social media. This is simply not good enough,” she says.

“Our expectation is clear: online platforms need take reasonable steps to ensure Australians can use their services in a safe manner, and to proactively minimise unlawful and harmful material and activity on their services.”

The social services minister, Amanda Rishworth, says combatting misogynistic attitudes and behaviour in the online and offline world will help achieve the national plan to end ********* against women and children in one generation.

“Around 25% of teenage boys in Australia look up to social media personalities who perpetuate harmful gender stereotypes and condone ********* against women – this is shocking,” she says.

“And particularly if this content is being served up in young men’s social feeds without any interaction whatsoever, social media companies need to do more.”

This is the hidden content, please

• Sign In
• or
• Sign Up

#unleashed #

This is the hidden content, please

• Sign In
• or
• Sign Up

#Instagrams #algorithms #blank #accounts #served #sexism #misogyny #Meta

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up