Google

Google's Project Dragonfly 'Terminated' In China (bbc.com) 41

An executive at Google said the company's plan to launch a censored search engine in China has been "terminated." The project was reportedly put on hold last year but rumors that it remained active persisted. From a report: "We have terminated Project Dragonfly," Google executive Karan Bhatia told the U.S. Senate Judiciary Committee. Buzzfeed, which reported the new comments, said it was the first public confirmation that Dragonfly had ended. A spokesman for Google later confirmed to the site that Google currently had no plans to launch search in China and that no work was being done to that end.
Google

To Break Google's Monopoly On Search, Make Its Index Public (bloomberg.com) 135

Robert Epstein, an American psychologist, professor, author and journalist critical of Google, argues that Google's monopoly on search can be broken by making its index public. An anonymous reader shares an excerpt from the report via Bloomberg: Different tech companies pose different kinds of threats. I'm focused here on Google, which I've been studying for more than six years through both experimental research and monitoring projects. (Google is well aware of my work and not entirely happy with me. The company did not respond to requests for comment.) Google is especially worrisome because it has maintained an unopposed monopoly on search worldwide for nearly a decade. It controls 92 percent of search, with the next largest competitor, Microsoft's Bing, drawing only 2.5%. Fortunately, there is a simple way to end the company's monopoly without breaking up its search engine, and that is to turn its "index" -- the mammoth and ever-growing database it maintains of internet content -- into a kind of public commons.

Doesn't Google already share its index with everyone in the world? Yes, but only for single searches. I'm talking about requiring Google to share its entire index with outside entities -- businesses, nonprofit organizations, even individuals -- through what programmers call an application programming interface, or API. Google already allows this kind of sharing with a chosen few, most notably a small but ingenious company called Startpage, which is based in the Netherlands. In 2009, Google granted Startpage access to its index in return for fees generated by ads placed near Startpage search results. With access to Google's index -- the most extensive in the world, by far -- Startpage gives you great search results, but with a difference. Google tracks your searches and also monitors you in other ways, so it gives you personalized results. Startpage doesn't track you -- it respects and guarantees your privacy -- so it gives you generic results. Some people like customized results; others treasure their privacy.
In closing, Epstein writes that dozens of Startpage variants would turn up within months of opening up access to Google's index. "Many would target niche audiences -- some small, perhaps, like high-end shoppers, and some huge, like all the world's women, and most of these platforms would do a better job of serving their constituencies than Google ever could," he writes.

"These aren't just alternatives to Google, they are competitors -- thousands of search platforms, each with its special focus and emphasis, each drawing on different subsets of information from Google's ever-expanding index, and each using different rules to decide how to organize the search results they display. Different platforms would likely have different business models, too, and business models that have never been tried before would quickly be tested."
Google

Google Tweaked Algorithm After Rise In US Shootings (theguardian.com) 190

A senior search engineer at Google revealed that the company had to tweak its algorithm to combat misinformation after mass shootings. The Guardian reports: "In these last few years, there's been a tragic increase in shootings," Pandu Nayak, who joined the company 14 years ago to work on its search engine, said. "And it turns out that during these shootings, in the fog of events that are unfolding, a lot of misinformation can arise in various ways. "And so to address that we have developed algorithms that recognize that a bad event is taking place and that we should increase our notions of 'authority', increase the weight of 'authority' in our ranking so that we surface high quality content rather than misinformation in this critical time here."

Authority, by Google's definition, means pages that comply with the company's search quality evaluator guidelines, a 166-page document (PDF) that the company distributes to its 16,000 search quality raters. Those employees are responsible for checking tweaks to Google's algorithm to ensure that they give the best results, rating search results on two scales: one that marks whether the searcher's needs are met (if the search is for "Google Jobs," for instance, a maps result showing the location of Google's head office "fails to meet" needs, while the company's career's page "fully meets"), and a second that marks the page's quality, defined over 80 pages of the guidelines with "very high quality MC" (main content), "very high level of E-A-T" (expertise, authoritativeness, trustworthiness) and "very positive reputation."

Google

Google's Robots.txt Parser is Now Open Source (googleblog.com) 32

From a blog post: For 25 years, the Robots Exclusion Protocol (REP) was only a de-facto standard. This had frustrating implications sometimes. On one hand, for webmasters, it meant uncertainty in corner cases, like when their text editor included BOM characters in their robots.txt files. On the other hand, for crawler and tool developers, it also brought uncertainty; for example, how should they deal with robots.txt files that are hundreds of megabytes large? Today, we announced that we're spearheading the effort to make the REP an internet standard. While this is an important step, it means extra work for developers who parse robots.txt files.

We're here to help: we open sourced the C++ library that our production systems use for parsing and matching rules in robots.txt files. This library has been around for 20 years and it contains pieces of code that were written in the 90's. Since then, the library evolved; we learned a lot about how webmasters write robots.txt files and corner cases that we had to cover for, and added what we learned over the years also to the internet draft when it made sense.

Businesses

Meal-Delivery Company GrubHub is Buying Thousands of Restaurant Web Addresses, Preventing Mom and Pop From Owning Their Slice of Internet (newfoodeconomy.org) 99

H. Claire Brown, reporting for The New Food Economy: GrubHub's commission fees had been inching upward over the years she'd [anecdote in the story] been working with the platform. There was the flat transaction fee, which hovered around 3 or 4 percent. Then there were marketing fees and costs for additional promotions. Shivane says she feels like the platform is increasingly pay to play: Spend more to promote your restaurant, and see your search rankings rise. Cut down on marketing spend, and watch your restaurant fall to the bottom of the page and lose sales.

"It's putting us in a financial hole. Last month, I paid $7,000 to GrubHub. That's my rent for the month," Shivane says. The New Food Economy viewed the company's invoice to Shivane's restaurant -- it was actually $8,000. We agreed to use only her first name and last initial in this story because she still uses the platform and fears the company could retaliate by dropping her restaurant to the bottom of its search rankings. Frustrated, Shivane started exploring other options. She says she thought about bulking up her restaurant's web presence and offering orders on her own site through a different service, one that offered a flat monthly rate and no commission fee.

There was just one problem: Someone already owned the web domain that matched her restaurant's name. She looked up the buyer. It was GrubHub. The New Food Economy has found that GrubHub owns more than 23,000 web domains. Its subsidiary, Seamless, owns thousands. We've published the full list here. Most of them appear to correlate with the names of real restaurants. The company's most recent purchase was in May of this year. Grubhub purchased three different domains containing versions of Shivane's restaurant's name -- in 2012, 2013, and 2014. "I never gave them permission to do that," she says.

Security

Western Intelligence Hacked Russia's Yandex To Spy On Accounts (reuters.com) 54

Hackers working for Western intelligence agencies broke into Russian internet search company Yandex in late 2018 deploying a rare type of malware in an attempt to spy on user accounts, Reuters reported Thursday, citing four people with knowledge of the matter. From the report: The malware, called Regin, is known to be used by the "Five Eyes" intelligence-sharing alliance of the United States, Britain, Australia, New Zealand and Canada, the sources said. Intelligence agencies in those countries declined to comment. Western cyberattacks against Russia are seldom acknowledged or spoken about in public. It could not be determined which of the five countries was behind the attack on Yandex, said sources in Russia and elsewhere, three of whom had direct knowledge of the hack. The breach took place between October and November 2018.

Yandex spokesman Ilya Grabovsky acknowledged the incident in a statement to Reuters, but declined to provide further details. "This particular attack was detected at a very early stage by the Yandex security team. It was fully neutralized before any damage was done," he said.

Music

Google Explains How It Licenses Song Lyrics For Search, Will Add Attribution (9to5google.com) 72

Over the weekend, Google Search was caught allegedly copying song lyrics from Genius.com. In response, Google published a long explanation of how lyrics in Search work and said that they will add attribution to note which third-party service is supplying the lyrics. 9to5Google reports: When you look up a song in Search, Google often returns a YouTube video with the Knowledge Panel featuring lyrics, links to streaming services, and other artist/album/release/genre info. A query that explicitly asks for "lyrics" will display the full text as the first item at the top of Google.com. The Wall Street Journal over the weekend reported on an accusation that Search was taking content from Genius. According to Google today, it does "not crawl or scrape websites to source these lyrics." When available, Google will pay music publishers for the right to display lyrics. However, in most cases, publishers do not have digital transcripts, with the search engine instead turning to third-party "lyrics content providers."

Google today reiterated that it's asking partners to "investigate the issue," with the third-party -- and not Google directly -- likely at fault for scraping Genius content. Meanwhile, Knowledge Panels in Search will soon gain attribution to note who is supplying digital lyrics text. "Google today reiterated that it's asking partners to 'investigate the issue,' with the third-party -- and not Google directly -- likely at fault for scraping Genius content," Google said in a blog post. "Meanwhile, Knowledge Panels in Search will soon gain attribution to note who is supplying digital lyrics text."

Facebook

Facebook Turned Off Search Features Used To Catch War Criminals, Child Predators, And Other Bad Actors (buzzfeednews.com) 84

The human rights and war crimes community is up in arms over Facebook's decision to turn off a set of advanced features in its graph search product, which is "a way to receive an answer to a specific query on Facebook, such as 'people in Nebraska who like Metallica,'" reports BuzzFeed News. "Using graph search, it's possible to find public -- and only public -- content that's not easily accessed via keyword search." The decision, which was not announced publicly, was likely made in an effort to limit data scandals and improve privacy. From the report: When Mark Zuckerberg personally introduced graph search in early 2013, he billed it as equal in importance to Facebook's News Feed and profile timeline. On launch day, the company also published a post offering journalists tips on how to use graph search. Over the years, graph search became a valuable tool for investigators, police officers, and journalists. At the same time, social media became a key source for uncovering war crimes, disinformation campaigns, child exploitation, and other crimes and abuses.

The move raised even more concern in the human rights and investigative journalism communities because Facebook appeared to thwart attempts to find workarounds. Henk van Ess, an investigator and trainer who works with Bellingcat, operates a tool that uses graph search to enable powerful searches of public content. After Facebook turned off some searches, he was able to find workarounds -- until the company blocked them. "I patched my tools 5 times and each time, after 2 hrs, the tools were crippled by FB," he wrote in a Twitter direct message. "Other toolmakers experienced the same." Van Ess now requires people to request permission from him to use his tool; he says he's been flooded with requests from people pursuing investigations "involving human rights abuses, war crimes, terrorism, extremism, white collar crime ... corruption, disinformation campaigns, environmental crimes, cybercrime -- the list just keeps on going."
A Facebook spokesperson said in a statement to BuzzFeed News: "The vast majority of people on Facebook search using keywords, a factor which led us to pause some aspects of graph search and focus more on improving keyword search. We are working closely with researchers to make sure they have the tools they need to use our platform."
Security

Malware Spotted Injecting Bing Results Into Google Searches (theregister.co.uk) 44

A new strain of malware intercepts and tampers with internet traffic on infected Apple Macs to inject Bing results into users' Google search results. The Register reports: A report out this month by security house AiroAV details how its bods apparently spotted a software nasty that configures compromised macOS computers to route the user's network connections through a local proxy server that modifies Google search results. In this latest case, it is claimed, the malware masquerades as an installer for an Adobe Flash plugin -- delivered perhaps by email or a drive-by download -- that the user is tricked into running. This bogus installer asks the victim for their macOS account username and password, which it can use to gain sufficient privileges to install a local web proxy and configure the system so that all web browser requests go through it. That proxy can meddle with unencrypted data as it flows in and out to and from the public internet.

A root security certificate is also added to the Mac's keychain, giving the proxy the ability to generate SSL/TLS certs on the fly for websites requested. This allows it to potentially intercept and tamper with encrypted HTTPS traffic. This man-in-the-middle eavesdropping works against HTTP websites, and any HTTPS sites that do not employ MITM countermeasures. When the user opens their browser and attempts to run a Google search on an infected Mac, the request is routed to the local proxy, which injects into the Google results page an HTML iframe containing fetched Bing results for the same query, weirdly enough.
As for why, "it's believed the Bing results bring in web ads that generate revenue for the malware's masterminds," the report says.
Books

Book Subtitles Are Getting Ridiculously Long. Blame it on SEO. (washingtonpost.com) 86

How many words can you fit in a subtitle? For a slew of modern books, the answer seems to be as many as possible. From a report: Just look at Julie Holland's "Moody Bitches: The Truth About the Drugs You're Taking, the Sleep You're Missing, the Sex You're Not Having, and What's Really Making You Crazy," Erin McHugh's "Political Suicide: Missteps, Peccadilloes, Bad Calls, Backroom Hijinx, Sordid Pasts, Rotten Breaks, and Just Plain Dumb Mistakes in the Annals of American Politics" and Ryan Grim's "We've Got People: From Jesse Jackson to Alexandria Ocasio-Cortez, the End of Big Money and the Rise of a Movement." Blame a one-word culprit: search.

Todd Stocke, senior vice president and editorial director at Sourcebooks, said that subtitle length and content have a lot to do with finding readers through online searches. "It used to be that you could solve merchandising communication on the cover by adding a tagline, blurb or bulleted list," he said. But now, publishers "pack the keywords and search terms into the subtitle field because in theory that'll help the book surface more easily." He should know. Sourcebooks will publish Shafia Zaloom's "Sex, Teens, and Everything in Between: The New and Necessary Conversations Today's Teenagers Need to Have about Consent, Sexual Harassment, Healthy Relationships, Love, and More" in September.

Amazon allows up to 199 characters for a book's title and subtitle combined, making the word combination possibilities, if not endless, vast. Anne Bogel, host of the podcast "What Should I Read Next?," is not generally a fan of the trend. "I don't feel respected as a reader when I feel like the subtitle was created not to give me a feeling of what kind of reading experience I may get, but for search engines," she said. When Bogel asked author friends how they came up with their subtitles, several told her they can't even remember which words they ended up using. That being said, sometimes titular long-windedness works.

EU

Google Appeals $1.7B EU AdSense Antitrust Fine (techcrunch.com) 44

Google has filed a legal appeal against the $1.7 billion antitrust penalty the European Commission laid against on its search ad brokering business three months ago. Antitrust officials found that, in contracts with major sites between 2006 and 2016, Google included restrictive contracts that could be seen as it trying to muscle rivals out of the market. The clauses reportedly included exclusivity measures, restrictions on how sites displayed ads from Google's rivals and requirements to give its ads better visibility and more prominent placement.

From a report: Google is appealing both earlier penalties but has also made changes to how it operates Google Shopping and Android in Europe in the meanwhile, to avoid the risk of further punitive penalties. In the case of AdSense, the Commission found that between 2006 and 2016 Google included restrictive clauses in its contracts with major sites that use its ad platform which Commission's current antitrust chief, Margrethe Vestager said could only be seen as intending to keep rivals out of the market. [...] Reached for comment, a Commission spokesperson told us: "The Commission will defend its decision in Court."
United States

Justice Department Is Preparing Antitrust Investigation of Google (cnbc.com) 144

According to The New York Times, the Justice Department is exploring whether to open a case against Google for potential antitrust violations (Warning: source may be paywalled; alternative source) relating to search and its other businesses, "putting renewed scrutiny on the company amid a growing chorus of criticism about the power of Big Tech." From the report: An investigation into how Google arranges search results could revive a case closed in 2013 by another government agency, the Federal Trade Commission. The five F.T.C. commissioners voted unanimously at the time against bringing charges against the company. Google agreed to make some changes to search practices tied to advertising. But this year, with a new antitrust task force announced in February, the trade commission renewed its interest in Google. In recent weeks, the commission referred complaints about the company to the Justice Department, which also oversees antitrust regulations, according to two people familiar with the actions. The commission has also told companies and others with complaints against Google to take them to the Justice Department.

The task force had been looking into Google's advertising practices and influence in the online advertising industry, according to two of the people. One of the people said the agency was also looking into its search practices. Most of Google's revenue comes from advertisements tied to its search results. If the Justice Department opens a formal investigation, it will be its first major antitrust case against a big tech company during the Trump administration. Google, Facebook and Amazon have come under intense bipartisan criticism, and calls to break up the firms have become a talking point in the race for the 2020 Democratic presidential nomination.

Wikipedia

The North Face Used Wikipedia To Climb To the Top of Google Search Results (adage.com) 105

An anonymous reader shares a report: When you first start planning a big trip, step one will likely happen at the Google search bar. Step two might be clicking onto the images of your target destination. The North Face, in a campaign with agency Leo Burnett Tailor Made, took advantage of this consumer behavior to keep its name top of mind with travelers considering an adventure sports excursion.

The brand and agency took pictures of athletes wearing the brand while trekking to famous locations around the world, including Brazil's Guarita State Park and Farol do Mampimptuba, Cuillin in Scotland and Peru's Huayna Picchu. They then updated the Wikipedia images in the articles for those locations so that now, the brand would appear in the top of Google image search results when consumers researched any of those locations -- all done for a budget of zero dollars. "Our mission is to expand our frontiers so that our consumers can overcome their limits. With the 'Top of Images' project, we achieved our positioning and placed our products in a fully contextualized manner as items that go hand in hand with these destinations," explained Fabricio Luzzi, CEO of The North Face Brazil in a statement.

According to the agency, the biggest obstacle of the campaign was updating the photos without attracting attention of Wikipedia moderators to sustain the brand's presence for as long as possible, as site editors could change them at any time. The "hack" worked, at least for a while, evident in a quick Google search of some of the places mentioned in the campaign's case study video.
Further reading: Wikimedia is not pleased.
AI

Wolfram Alpha Search Engine Turns 10: Remains Independent, Private, and Free of External Advertising 41

For more than three decades, Stephen Wolfram, a 59-year-old scientist, software designer and entrepreneur, has built software that has attracted an avid following among mathematicians and scientists. His Mathematica program for symbolic mathematical computation and its programming language, Wolfram Language, are favorites of the intelligentsia of the quant world in universities and corporations. Wolfram Alpha, one of his creations, is a unique search engine that does not forage the web, but culls its own painstakingly curated database to find answers. This week, the search engine turned 10. On the big occasion, Mr. Wolfram has shared some insight: It was a unique and surprising achievement when it first arrived, and over its first decade it's become ever stronger and more unique. It's found its way into more and more of the fabric of the computational world, both realizing some of the long-term aspirations of artificial intelligence, and defining new directions for what one can expect to be possible. Oh, and by now, a significant fraction of a billion people have used it. And we've been able to keep it private and independent, and its main website has stayed free and without external advertising.

As the years have gone by, Wolfram Alpha has found its way into intelligent assistants like Siri, and now also Alexa. It's become part of chatbots, tutoring systems, smart TVs, NASA websites, smart OCR apps, talking (toy) dinosaurs, smart contract oracles, and more. It's been used by an immense range of people, for all sorts of purposes. Inventors have used it to figure out what might be possible. Leaders and policymakers have used it to make decisions. Professionals have used it to do their jobs every day. People around the world have used it to satisfy their curiosity about all sorts of peculiar things. And countless students have used it to solve problems, and learn.
The footage of the launch of Alpha, from 10 years ago.
Open Source

Microsoft Open-Sources a Crucial Algorithm Behind Its Bing Search Services (techcrunch.com) 55

An anonymous reader quotes a report from TechCrunch: Microsoft today announced that it has open-sourced a key piece of what makes its Bing search services able to quickly return search results to its users. By making this technology open, the company hopes that developers will be able to build similar experiences for their users in other domains where users search through vast data troves, including in retail, though in this age of abundant data, chances are developers will find plenty of other enterprise and consumer use cases, too. The piece of software the company open-sourced today is a library Microsoft developed to make better use of all the data it collected and AI models it built for Bing .

With the Space Partition Tree and Graph (SPTAG) algorithm that is at the core of the open-sourced Python library, Microsoft is able to search through billions of pieces of information in milliseconds. Vector search itself isn't a new idea, of course. What Microsoft has done, though, is apply this concept to working with deep learning models. First, the team takes a pre-trained model and encodes that data into vectors, where every vector represents a word or pixel. Using the new SPTAG library, it then generates a vector index. As queries come in, the deep learning model translates that text or image into a vector and the library finds the most related vectors in that index. The library is now available under the MIT license and provides all of the tools to build and search these distributed vector indexes. You can find more details about how to get started with using this library -- as well as application samples -- here.

Google

Google Is About To Have a Lot More Ads On Phones (theverge.com) 163

The Verge reports on the new ad types Google announced today that will start showing up throughout its mobile products, including some that interrupt the core Google search and discovery experiences. From the report: Google searches on mobile will soon include "gallery" ads that allow advertisers to display multiple images for users to swipe through. You'll also begin to see ads in Google's discover feed -- the feed of news stories that you find built into many Android home screens, inside the Google app, and on Google's mobile homepage -- though they'll only appear in select locations for now. The new ad formats are meant to make ads a lot more noticeable. In a blog post, Google ad chief Prabhakar Raghavan says that, in tests, gallery ads resulted in "up to 25 percent more interactions" than traditional search ads.

Gallery ads will only be launching on mobile, not the desktop. Discover ads will appear in Google's mobile app, as well as on the discover feed on Android phones. Google tells us those ads won't appear in the discover feed that's built into the google.com mobile homepage. [...] The discover feed -- a personalized feed of recommended news stories that Google displays on mobile -- will also be getting ads for the first time. They'll appear just like any other story, with an image on top, a headline, and a subject field with more information. But they'll have a small badge that says "ad" to let users know it's sponsored. Those ads will extend to YouTube as well, where they'll slot in alongside recommended videos. Discover ads will also roll out later this year.

Google

Google's Censored Search Would Help China 'Be More Open', Said Ex-CEO Eric Schmidt (theintercept.com) 91

Former Google CEO Eric Schmidt has defended the company's plan to build a censored version of its search engine in China. From a report: In an interview with the BBC on Monday, Schmidt said that he wasn't involved in decisions to build the censored search platform, codenamed Dragonfly. But he insisted that there were "many benefits" to working with China and said he was an advocate of operating in the country because he believed it could "help change China to be more open." As The Intercept first revealed in August, Google developed a prototype of the censored search engine that was designed to remove content that China's ruling Communist Party regime deems sensitive. The search engine would have blacklisted thousands of words and phrases, including terms such as "human rights," "student protest," and "Nobel Prize" in Mandarin.
Google

Google Creates 'Dedicated Placement' in Search Results For AMP Stories, Starting With Travel Category (venturebeat.com) 42

Google says it will soon introduce a "dedicated placement" in Google Search for AMP Stories in specific categories, like travel, along with components that let AMP Story creators embed interactive content. From a report: The dedicated placement -- a carousel of visual covers from Stories -- will appear beneath the Search bar on mobile for queries like "Things to do in Tokyo" and "The top 10 places to go in Tokyo." Tapping on any of the covers will launch the corresponding AMP Story, which you'll be able to navigate using swipe gestures and scroll gestures. Swiping far enough to the left will open the next Story on the list. The new discoverability feature will roll out in the coming months on Search. AMP Story categories like gaming, fashion, recipes, movies, and TV shows will follow afterward, Google says.
Bug

Reporter Recounts a Quirk in Google's Search Algorithm That Resulted in His Phone Number Getting Listed as Facebook's Customer Support (vice.com) 49

Lorenzo Franceschi-Bicchierai, writing for Vice's Motherboard: I'm waiting for the subway when the phone rings. On the other end of the line an angry woman is shouting at me about her Facebook account. I hang up. A few hours later, I'm walking to get some lunch when someone calls. "I forgot my Facebook password," the man says. I sigh, and -- once again -- explain that I can't help. [...] This keeps happening. In the last three days, I've gotten more than 80 phone calls. Just today, in the span of eight minutes, I got three phone calls from people looking to talk to Facebook. I didn't answer all of them, and some left voicemails.

Initially, I thought this was some coordinated trolling campaign. As it turns out, if you Googled "Facebook phone number" on your phone earlier this week, you would see my cellphone as the fourth result, and Google has created a "card" that pulled my number out of the article and displayed it directly on the search page in a box. The effect is that it seemed like my phone number was Facebook's phone number, because that is how Google has trained people to think. Considering that on average, according to Google's own data, people search for "Facebook phone numberâ tens of thousands of times every month, I got a lot of calls.

Communications

Google Is Adding Augmented Reality To Search (theverge.com) 18

Augmented reality is coming to Google Search, allowing you to "check out a pair of shoes in the 'real world' while you're shopping online or put an animated shark in your living room," reports The Verge. From the report: At I/O, Google offered a few different examples of how its AR search options might work. If you search for musculature, for instance, you can get a model of human muscles -- which you can either examine as an ordinary 3D object on your screen or overlay on a camera feed, letting you "see" the object in the real world. If you're looking at shopping results, you can preview a piece of clothing with your existing wardrobe.

3D AR objects will start showing up in search results later this year, and developers can add support for their own objects by adding "just a few lines of code." It's apparently already working with NASA, New Balance, Samsung, Target, Volvo, and other groups to add support for their 3D models.

Slashdot Top Deals