31 votes

Can Mark Zuckerberg fix Facebook before it breaks democracy?

23 comments

  1. [16]
    Neverland
    (edited )
    Link
    First, Deimos, thanks for posting this. I would likely have not read it otherwise. I am only half way through this very long read, but I thought I should post this in at least 2 parts. Honestly,...

    First, Deimos, thanks for posting this. I would likely have not read it otherwise.

    I am only half way through this very long read, but I thought I should post this in at least 2 parts. Honestly, it’s hard to respond to something like this outside of a very long personal essay. So let’s call this part 1 of my response, and sorry that it’s still a wall of text. I took the time to do this because outside of climate change, this is the biggest issue of our time and it bugged me that the comment counter said: 0, while the vote counter said 10.

    For many years, Zuckerberg ended Facebook meetings with the half-joking exhortation “Domination!” Although he eventually stopped doing this (in European legal systems, “dominance” refers to corporate monopoly), his discomfort with losing is undimmed.

    This is the setup, win at all costs. It is no wonder that later a Roman emperor is mentioned as an idol.

    Zuckerberg was spending much of his time conferring with heads of state and unveiling plans of fantastical ambition, such as building giant drones that would beam free Internet (including Facebook) into developing countries.

    This article is excellent, but this part is extremely naive. As we have learned seen since that time, when FB introduces free data in developing markets, users start to think that FB is the internet as it is one of the few whitelisted (free) sites.

    The Internet Research Agency, a firm in St. Petersburg working for the Kremlin, drew hundreds of thousands of users to Facebook groups optimized to stoke outrage, including Secured Borders, Blacktivist, and Defend the 2nd. They used Facebook to organize offline rallies, and bought Facebook ads intended to hurt Hillary Clinton’s standing among Democratic voters. (One read “Hillary Clinton Doesn’t Deserve the Black Vote.”) With fewer than a hundred operatives, the I.R.A. achieved an astonishing impact: Facebook estimates that the content reached as many as a hundred and fifty million users.

    If accurate, this ratio is the best ROI that I have ever heard of. Less than 100 agents to influence over 100 million people. Imagine if that kind of asymmetric power was used to push good, like say dropping us off of fossil fuels.

    At Facebook’s annual shareholder meeting, in May, executives struggled to keep order. An investor who interrupted the agenda to argue against Zuckerberg’s renomination as chairman was removed. Outside, an airplane flew a banner that read “YOU BROKE DEMOCRACY.” It was paid for by Freedom from Facebook, a coalition of progressive groups that have asked the F.T.C. to break up the company into smaller units.

    I had never heard of this protest, and I think I pay decent attention. Giant corp’s control of the narrative is freaking scary. It reminds me of Sandberg’s ability to remove a negative narrative about her from a recent NYT piece.

    And now everyone says, Is this a trick? And the question Mark Zuckerberg is dealing with is: Should my company be the arbiter of truth and decency for two billion people? Nobody in the history of technology has dealt with that.”

    This is the unanswered question of our monopolized era, isn’t it? It’s almost as if anti-trust action had a purpose!

    Zuckerberg told me, “You have all these good and bad and complex figures. I think Augustus is one of the most fascinating. Basically, through a really harsh approach, he established two hundred years of world peace.” For non-classics majors: Augustus Caesar, born in 63 B.C., staked his claim to power at the age of eighteen and turned Rome from a republic into an empire by conquering Egypt, northern Spain, and large parts of central Europe. He also eliminated political opponents, banished his daughter for promiscuity, and was suspected of arranging the execution of his grandson.
    “What are the trade-offs in that?” Zuckerberg said, growing animated. “On the one hand, world peace is a long-term goal that people talk about today. Two hundred years feels unattainable.” On the other hand, he said, “that didn’t come for free, and he had to do certain things.” In 2012, Zuckerberg and Chan spent their honeymoon in Rome. He later said, “My wife was making fun of me, saying she thought there were three people on the honeymoon: me, her, and Augustus. All the photos were different sculptures of Augustus.” The couple named their second daughter August.

    This is not a good sign in my book. That’s all I have to say on that.

    When I asked Chan about how Zuckerberg had responded at home to the criticism of the past two years, she talked to me about Sitzfleisch, the German term for sitting and working for long periods of time. “He’d actually sit so long that he froze up his muscles and injured his hip,” she said.

    Well holy shit, Zuck and I have something in common. My right hip hurts all the time from that.

    His onetime speechwriter Katherine Losse, in her memoir, “The Boy Kings,” explained that the “engineering ideology of Facebook” was clear: “Scaling and growth are everything, individuals and their experiences are secondary to what is necessary to maximize the system.” Over time, Facebook devoted ever-greater focus to what is known in Silicon Valley as “growth hacking,” the constant pursuit of scale. Whenever the company talked about “connecting people,” that was, in effect, code for user growth.

    Alex Schultz, a founding member of the Growth Team, said that he and his colleagues were fanatical in their pursuit of expansion. “You will fight for that inch, you will die for that inch,” he told me. Facebook left no opportunity untapped. In 2011, the company asked the Federal Election Commission for an exemption to rules requiring the source of funding for political ads to be disclosed. In filings, a Facebook lawyer argued that the agency “should not stand in the way of innovation.”

    Well, this is the crux of the headline, isn’t it? Pure growth driven soulless-ness.

    To gain greater reach, Facebook had made the fateful decision to become a “platform” for outside developers, much as Windows had been in the realm of desktop computers, a generation before. The company had opened its trove of data to programmers who wanted to build Facebook games, personality tests, and other apps. After a few months at Facebook, Parakilas was put in charge of a team responsible for making sure that outsiders were not misusing the data, and he was unnerved by what he found. Some games were siphoning off users’ messages and photographs. In one case, he said, a developer was harvesting user information, including that of children, to create unauthorized profiles on its own Web site. Facebook had given away data before it had a system to check for abuse. Parakilas suggested that there be an audit to uncover the scale of the problem. But, according to Parakilas, an executive rejected the idea, telling him, “Do you really want to see what you’ll find?”

    Holy shit, as an outsider, this is really what it seemed like... I never understood the business case for opening the platform for all of this abuse and data harvesting. I never understood why a competing platform could not just make an FB game and harvest the graph. Couldn’t Zinga have done that?

    New hires learned that a crucial measure of the company’s performance was how many people had logged in to Facebook on six of the previous seven days, a measurement known as L6/7. “You could say it’s how many people love this service so much they use it six out of seven days,” Parakilas, who left the company in 2012, said. “But, if your job is to get that number up, at some point you run out of good, purely positive ways. You start thinking about ‘Well, what are the dark patterns that I can use to get people to log back in?’ ”

    YouTube seems to have crossed this Rubicon long ago.

    Researchers found that, during the 2010 midterm elections, Facebook was able to prod users to vote simply by feeding them pictures of friends who had already voted, and by giving them the option to click on an “I Voted” button. The technique boosted turnout by three hundred and forty thousand people—more than four times the number of votes separating Trump and Clinton in key states in the 2016 race. It became a running joke among employees that Facebook could tilt an election just by choosing where to deploy its “I Voted” button.

    Imho, the GOP visit to FB, prior to the 2016 election, prevented this from happening.. “Mark, have you heard of The Sherman Act?” I would give a lot to know what was exchanged in that meeting. I believe that when one becomes a monopoly, you become the government’s bitch, or else, antitrust enforcement.

    15 votes
    1. Deimos
      Link Parent
      Thanks for starting to post your thoughts on it, I haven't even had a chance to read it myself yet (hopefully later tonight). This is another one of the times that "long read" felt completely...

      Thanks for starting to post your thoughts on it, I haven't even had a chance to read it myself yet (hopefully later tonight). This is another one of the times that "long read" felt completely inadequate, it's over 14,000 words long. Most typical "reading time" estimates will put that at about an hour of reading if you just go straight through it.

      10 votes
    2. [14]
      Eva
      Link Parent
      What anti-trust actions could be taken IRT Facebook? They have a single primary product, and haven't really used any anti-competitive behaviours that'd cause something like a split to happen. And...

      And now everyone says, Is this a trick? And the question Mark Zuckerberg is dealing with is: Should my company be the arbiter of truth and decency for two billion people? Nobody in the history of technology has dealt with that.”

      This is the unanswered question of our monopolized era, isn’t it? It’s almost as if anti-trust action had a purpose!

      What anti-trust actions could be taken IRT Facebook? They have a single primary product, and haven't really used any anti-competitive behaviours that'd cause something like a split to happen. And it's not like alternatives don't exist, and viable ones at that.

      3 votes
      1. [4]
        Deimos
        Link Parent
        Here's an article from last week about exactly this topic: It’s time to break up Facebook The article is mostly talking with Tim Wu, who's writing a book about the topic that comes out soon. I'm a...

        Here's an article from last week about exactly this topic: It’s time to break up Facebook

        The article is mostly talking with Tim Wu, who's writing a book about the topic that comes out soon. I'm a really big fan of his, his previous books (The Master Switch, and The Attention Merchants) were both excellent.

        10 votes
        1. [3]
          Eva
          Link Parent
          That was an interesting read; thank you!

          That was an interesting read; thank you!

          1 vote
          1. [2]
            Deimos
            Link Parent
            If you're interested in more on the topic, Scott Galloway has done quite a few great talks related to breaking up the big four tech companies as well. Not sure if this is the best one, but here's...

            If you're interested in more on the topic, Scott Galloway has done quite a few great talks related to breaking up the big four tech companies as well. Not sure if this is the best one, but here's a relatively recent one (that I haven't watched): https://www.youtube.com/watch?v=6NyFRIgulPo

            This one (which I have watched) is really good, but I think it's focused mostly on Amazon, if I remember right: https://www.youtube.com/watch?v=GWBjUsmO-Lw

            6 votes
      2. [7]
        spit-evil-olive-tips
        Link Parent
        The most popular Facebook alternative is probably Instagram...which is owned by Facebook. Splitting them up into two companies seems like it would be an easy anti-trust step.

        And it's not like alternatives don't exist, and viable ones at that.

        The most popular Facebook alternative is probably Instagram...which is owned by Facebook. Splitting them up into two companies seems like it would be an easy anti-trust step.

        5 votes
        1. [6]
          Eva
          Link Parent
          Instagram is for sharing images with people you aren't connected with, and isn't really an alternative; it's just an image sharing platform. Given that the purchase wasn't blocked in the first...

          Instagram is for sharing images with people you aren't connected with, and isn't really an alternative; it's just an image sharing platform.

          Given that the purchase wasn't blocked in the first place, I don't understand why they would do anything now.

          There're always things like Twitter, VK and etcetera; and from a software perspective it's not like there aren't thousands of alternatives.

          1 vote
          1. [5]
            Neverland
            Link Parent
            Instagram is certainly a social network at this point. But more to the point, the best answer that Zuckerberg could give Congress to the question “Is Facebook a monopoly?” was “Well it certainly...

            Instagram is certainly a social network at this point. But more to the point, the best answer that Zuckerberg could give Congress to the question “Is Facebook a monopoly?” was “Well it certainly doesn’t feel like that to me.”. I should add that my link does not definively say, yes, FB is a monopoly.

            5 votes
            1. [4]
              Eva
              Link Parent
              They're social networks, yeah, but they're focusing on entirely different things. Like cars versus airplanes, I'd think was an apt comparison. (The link makes a great example of how Facebook and...

              They're social networks, yeah, but they're focusing on entirely different things. Like cars versus airplanes, I'd think was an apt comparison. (The link makes a great example of how Facebook and YouTube aren't really competitors, given YT's focus on video; and I think the same applies to Instagram. Worth noting it's on the pro-monopoly side, though.)

              Going to comment on your other comment in this thread, just because it seems easier to keep one thread going rather than two.

              It depends on what you count as a major player, really; Google+ was never bigger than YouTube, and by many metrics, YouTube's a social media platform. (Although I can see it sway either way, there.)

              There's also Twitter, which is the tenth most popular website in the world, not even getting into the US (where I think it's like fifth?)

              And there are also platforms like VK with 500mm users; not to mention Chinese platforms like Weibo and WeChat.

              2 votes
              1. [3]
                Neverland
                Link Parent
                I do concede that the question of is FB a monopoly, is not a slam dunk. However, you also mentioned VK and WeChat, I was only referring to US networks so that the Sherman Act, and the FTC would apply.

                I do concede that the question of is FB a monopoly, is not a slam dunk.

                However, you also mentioned VK and WeChat, I was only referring to US networks so that the Sherman Act, and the FTC would apply.

                4 votes
                1. [2]
                  Eva
                  Link Parent
                  I could be wrong, here, but doesn't the Sherman Act take note of foreign companies? Hence why the text of it says that it similarly applies to foreign nations...?

                  I could be wrong, here, but doesn't the Sherman Act take note of foreign companies? Hence why the text of it says that it similarly applies to foreign nations...?

                  1 vote
                  1. Neverland
                    (edited )
                    Link Parent
                    That’s a great point. I likely could have used better phrasing stated my point more thoughtfully. I guess my point is that foreign networks are not anywhere near the top of the market share of US...

                    That’s a great point. I likely could have used better phrasing stated my point more thoughtfully. I guess my point is that foreign networks are not anywhere near the top of the market share of US users.

                    1 vote
      3. burkaman
        Link Parent
        Facebook, Messenger, Instagram, WhatsApp, Oculus, Onavo, and probably many others could all be separate companies.

        They have a single primary product

        Facebook, Messenger, Instagram, WhatsApp, Oculus, Onavo, and probably many others could all be separate companies.

        3 votes
      4. Neverland
        Link Parent
        After having vanquished half-assed Google +, they were the only major social player left, weren’t they? At the very least they should have been, or should be in the future, prevented from buying...

        After having vanquished half-assed Google +, they were the only major social player left, weren’t they? At the very least they should have been, or should be in the future, prevented from buying competitors like Insta, Snap, WhatsApp, etc. Outside of Sherman Act actions, the FTC can have a say in this if it wasn’t an active enabler, right?

        1 vote
  2. [4]
    teaearlgraycold
    (edited )
    Link
    Okay, I just finished this monster (listened to it thanks to the excellent recording). I'm left with one major question. Why does distribution of targeted information seem to favor malicious...

    Okay, I just finished this monster (listened to it thanks to the excellent recording).

    I'm left with one major question. Why does distribution of targeted information seem to favor malicious intentions? In particular it seems that the Facebook model favors disinformation. Mark says that the vast majority of news shared on Facebook is not "fake news". A few hundred Russians influenced a hundred million Americans. It's obvious that the platform lends itself to amplification of these ideas.

    Is this something about humanity that we need to accept? That the ability to broadcast to the world is dangerous. That people like to hate and fear. Perhaps the only thing that prevented this from happening before was ignorance.

    6 votes
    1. [3]
      ourari
      Link Parent
      Capturing the truth is complicated, requires time, money, and effort. Facts can't be tailored to suit the user. Lies are cheap, quick, and can be shaped and disseminated in ways that exploit...

      Capturing the truth is complicated, requires time, money, and effort. Facts can't be tailored to suit the user.
      Lies are cheap, quick, and can be shaped and disseminated in ways that exploit humans' vulnerabilities. Press a few metaphorical buttons and the likes and shares start flowing.
      It's no coincidence that we're in the midst of debate about censorship on online platforms. It's one of the few possible ways to combat the problem at this scale.

      7 votes
      1. [2]
        teaearlgraycold
        Link Parent
        Thanks, that's part of the wisdom I was looking for (although the truth does have a bit of flexibility through partial omission). Would the situation be better if there were a dozen competing...

        Facts can't be tailored to suit the user.

        Thanks, that's part of the wisdom I was looking for (although the truth does have a bit of flexibility through partial omission).

        Would the situation be better if there were a dozen competing social media platforms? Wouldn't that make it a more difficult process to engineer lies?

        3 votes
        1. ourari
          (edited )
          Link Parent
          That's not something I have an answer to (yet?). So, thinking out loud time. My gut says, probably not. Influence campaigns would still be relatively easy, especially if you can automate it....

          Would the situation be better if there were a dozen competing social media platforms?

          That's not something I have an answer to (yet?). So, thinking out loud time.

          My gut says, probably not. Influence campaigns would still be relatively easy, especially if you can automate it. Combating the abuse could be harder. Small platforms have fewer means, and each platform would have to figure it out on their own - if they even want to. They could of course decide to work together.

          Smaller platforms (as in less users) will probably have better insight in behavior on their platforms, but they might not have the resources to combat attacks. Conversely, attacks may look more organic if done on a small scale on a lot of small platforms instead of what's happening now and go unnoticed because of that.

          Large platforms have means and large data sets to learn from, and they can roll out solutions to (hundreds of) millions of users at once.

          I'm sure there are lots of angles that I'm not seeing - or not seeing correctly - so I'm hoping others will chime in.

          A closely related discussion about federated platforms like Mastodon is currently underway. It may shed some more light on the matter. Or make it more complicated, which I guess is good too ;)
          There was a really good conversation about it on Twitter which I can't find of course. But there is this:

          https://nolanlawson.com/2018/08/31/mastodon-and-the-challenges-of-abuse-in-a-federated-system/

          Edit: Some thoughts on the flaws of Mastodon/the fediverse:

          https://twitter.com/rahaeli/status/1036304096280621063

          2 votes
  3. aki
    Link
    I really appreciate how this essay is able to lay out the whole situation and give us a perspective on his POV. I think seeing his struggles with this and his many mistakes really illustrates the...

    I really appreciate how this essay is able to lay out the whole situation and give us a perspective on his POV. I think seeing his struggles with this and his many mistakes really illustrates the core of the problem to me - the people creating social media networks are software engineers, not social engineers. The design and moderation of a social network platform that becomes so ubiquitous has a large hand in shaping how people interact with one another. Similar to how the medium of handwritten letters, email, text messages and instant messaging all shape how people communicate and change how they interact, social media platforms warp communication through their design.

    Putting the power to shape how we communicate with one another (and by extension of that in some sense also how we think) in the hands of a cooperation whose main goal will always be to garner more profit is more dangerous than people give it credit for. That said, reading a retelling of this ongoing saga with Zuckerberg’s account of his own struggles reminds me that it isn’t exactly the fault of the company either - we gave them this power and now they have to struggle with how they choose to use it. Now it’s up to them to decide, will they change their platform to provide a basis for meaningful, truthful communication?

    2 votes
  4. [2]
    annadane
    Link
    I'm not sure I even agree with the premise of the title. If Facebook is powerful enough to "break democracy" maybe it wasn't that strong to begin with

    I'm not sure I even agree with the premise of the title. If Facebook is powerful enough to "break democracy" maybe it wasn't that strong to begin with

    1. json
      Link Parent
      Democracy in most countries has been broken long before Facebook came along.

      Democracy in most countries has been broken long before Facebook came along.