Sign up FAST! Login

What Github Did to Kill Its Trolls


Stashed in: User Generated Content, Teh Internets, Awesome, GitHub, Haters!, Trolling!, GitHub

To save this post, select a stash from drop-down menu or type in a new one:

Just two years ago, GitHub was an unpleasant place.

It was 2014 and the company was growing rapidly as a hub for programmers to collaborate on coding projects. But as its user base grew, so too did its problems. A GitHub developer, Julie Ann Horvath, left the company amid searing accusations of sexual and gender-based harassment, putting GitHub at the center of bad press for weeks and leading to the resignation of the company’s CEO.

To make matters worse, GitHub soon realized such problems weren’t limited to the office. Bullying and discrimination ran rampant on the site. There was systemic discrimination against women, with female coders often taken less seriously than their male peers. Petty disagreements devolved into flame wars in project comments. A bitter ex followed his former girlfriend from project to project, saying nasty things about her. And racist, sexist trolls sometimes co-opted features meant to enable collaboration to carry out vicious attacks, using, for example, a people-tagging feature to tag their targets on projects with racist names, transforming their portfolios into a slur of racist epithets.

Nicole Sanchez, the company’s VP of Social Impact, told that these are the “dangers and pitfalls of online life,” and not unique to GitHub, but GitHub wanted to try to prevent them.

It might surprise you that a website built for programmers to share code could become a hotbed of online harassment. But GitHub, valued at $2 billion, is a social network in nature, a combination of Facebook and LinkedIn for computer programmers, and involves a lot of user-to-user interaction. And along with that, on the internet, usually comes abuse.

Hoping to recover and heal its bruised image, GitHub hired Sanchez, who at the time had just started Vaya, a diversity consulting firm.

“We want to connect every developer in the world, and to do that we need to build an inclusive community where everyone feels safe and welcome,” said CEO Chris Wanstrath.

She hired February Keeney, a half-Puerto Rican transgender woman, to lead a new Community and Safety team to attack the problem of harassment on the site.

It was a difficult stance to take given the existing culture in Silicon Valley. GitHub, like so many tech companies, had long feared tamping down on what its users could say and do. 

Many techies feel that the internet is supposed to be open and free and that cracking down on even the most unseemly user behavior infringes on rights to free speech. Twitter, for example, had long refused to address its own problem with abuse, referring to itself as the “free speech wing of the free speech party.”

“People were so dogmatic about open source,” said Sanchez. “It meant that it has to be open all the time and accessible to everyone without question.”

Change-averse GitHub employees complained anonymously in the press that Sanchez was trying to “to control culture,” but eventually she won most of them over.

“It’s not just that harassment is unpleasant,” Sanchez told me. “It’s that we were losing people.”

A 2014 survey of women who had recently left the tech industry found that culture—including harassment—was a major factor in their decisions. GitHub viewed a diverse user base as essential to the company’s success and decided it needed to snuff out harassment to achieve it.

GitHub didn’t just need a new code of conduct—it needed to consider how every tiny detail of its design might be exploited to harass. Trolls be damned.

...

GitHub is not the only Silicon Valley company to have realized that ugly online behavior will not go away on its own. Two years ago, technology companies typically met calls to crack down on bullying with either a defense of free speech or a shrug. But scandalcriticism and harassment horror stories have forced a reconsideration of that approach.

When former Twitter CEO Dick Costolo famously admitted last February that “we suck at dealing with abuse,” it was a call to arms. Since then, Twitter and other companies have vigorously rolled out attempts at solutions. In September, Instagram announced a new feature allowing individual users to block offensive words. This fall, Google revealed it was building A.I. to combat internet trolls. Even the internet’s seedy underbelly, Reddit, has placed bans on its most toxic quadrants.

Twitter is Silicon Valley’s cautionary tale of what happens when you ignore the zeitgeist. 

Over its decade of existence, Twitter has mostly ignored abuse, making it a prime destination for trolls and hateHigh-profile users have fled the network, citing harassment. As the embattled company has struggled to find a buyer in recent months, some have speculated that Twitter’s harassment problem has played a role.

Trolls have become the scourge of the internet era. The sad fact of the matter is that the internet is chock full of a**holes; something really ought to be done about it.

But how do you rid the online world of violent verbiage and hatred when violence and hatred so thoroughly permeate the world itself? To use Twitter again as the unfortunate example, over the past two years it has banned revenge porn, issued new anti-harassment rules, established a trust and safety council and suspended high-profile users it considers abusive. And still, it seems, abuse has flourished.

“On Twitter,” BuzzFeed’s Charlie Warzel wrote earlier this year, “abuse is not just a bug, but—to use the Silicon Valley term of art—a fundamental feature.”

There is no miraculous healing salve for an internet of hate.

“There is no end of ideas about solutions for online harassment,” said Nathan Matias, a researcher at MIT studying ways to reduce harassment and discrimination online. “There is a universe of possible outcomes, and right now we have very little evidence that any one solution will lead to the outcome desired.”

So how did GitHub do it?

“At the start of my career, I had a lot of male privilege,” Ehmke told me. “Intellectually I knew that things like this happened, but until I transitioned I really didn’t fully understand. Open source is not very welcoming to people who are not male or white.”

Everyone I spoke with at GitHub underscored that the most important step in addressing harassment and diversity on GitHub was first solving those problems within the company itself.

“If there is not diversity at the front end of the funnel there is no ability to be able to deliver diversity to your customers on the other side,” Avalos, who is Puerto Rican and joined GitHub in its boss-less era, told me. “We don’t want to have blinders to things in the product that are alienating people.”

The Community and Safety team, made up of six people, includes two people who identify as transgender, four as women, three as people of color, and two “token white men.” It is, in other words, a lot more diverse than your average Silicon Valley engineering team.

Their job isn’t just to build new anti-harassment tools, but to vet new GitHub features and anticipate how they might be used for abuse.

“We’re not just an engineering group at GitHub,” Ehmke told me. “We’re considered critical infrastructure. At GitHub, these things are as important as keeping the lights on.”

The biggest change the team has made is asking GitHub engineers to build “consent and intent” into the platform. Users should have the right to consent to being tagged by another user for example. That would have prevented Ehmke’s racist tagging experience. So GitHub tweaked the project-tagging feature to require user approval.

“We don’t want to have blinders to things in the product that are alienating people.”

Intent, though, is trickier. Not every person who says something that sounds offensive on GitHub intends to actually say something offensive. “You suck” can be a mean-spirited jab or a playful joke between friends.

“We realized that harassing behaviors really fall into two buckets,” said Keeney. “There is the intentional bigot. And then there is the person who, like, tells Asian driver jokes without realizing they are racist.”

GitHub needed a way to handle offensive behavior with more dexterity and nuance.

Last month, the company released a proposal for community guidelines. It included rules for banned behavior—doxxing, discrimination and bullying—and spelled out clearly what constitutes those behaviors. There are consequences for breaking the rules, from content removal to account termination.

Being GitHub, it has asked its community for feedback. One user looked at the proposed guidelines, and suggested its ban on pornography shut out projects that might have to do with sex education or reproductive health. Ultimately, the best way to meet community needs, GitHub decided, is to ask for the community’s help.

Moderating comments, for example, might be a job better shared by both GitHub and open-source project managers better equipped to tell if a potentially offensive joke actually offended.

Stack Overflow has a penalty box for its spammers and trolls before banning them:

http://businessinsider.com/joel-spolsky-stack-exchange-interview-2016-12

You May Also Like: