Data scraping 'doesn't pass the sniff test' for causing Twitter rate limit: Roth

  • 📰 BusinessInsider
  • ⏱ Reading Time:
  • 61 sec. here
  • 3 min. at publisher
  • 📊 Quality Score:
  • News: 28%
  • Publisher: 51%

Health Health Headlines News

Elon Musk blamed data scraping for strict 'rate limits' on viewing tweets. Twitter's former head of trust and safety says it's not the first time the site's been broken by someone 'bumbling around in the rate limiter.'

As Twitter users scrolled through the site, once they reached the new viewing limits, no new content would be displayed. A notification appeared instead reading either"Something went wrong. Try reloading," or "Sorry, you are rate limited. Please wait a few moments then try again,"The sporadic changes contributed to a sense of unease around the restrictions.

"It just doesn't pass the sniff test that scraping all of a sudden created such dramatic performance problems that Twitter had no choice but to put everything behind a login," Yoel Roth wrote in a thread about the Twitter outage on Bluesky social, a rival app still in beta testing that on Saturday prohibited anyone making new accounts due to the volume of users migrating from Twitter.

Roth, who worked on the user trust and site integrity teams at Twitter for more than seven years, added:"Scraping was the open secret of Twitter data access. We knew about it. It was fine." Roth, as well as Musk, did not immediately respond to Insider's requests for comment. The Twitter press team replied with"There's some legitimacy to Twitter and Reddit being upset with AI companies for slurping up social data gratis in order to train commercially lucrative models," Roth added."But they should never forget that it's not *their* data — its ours. A solution to parasitic AI needs to be user-centric, not profit-centric.

The limited functionality on Twitter comes amid a scramble to negotiate with Google over cloud storage services after

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 729. in HEALTH

Health Health Latest News, Health Health Headlines