Wired has published a book review of sorts of a freely downloadable book called Untangling the Web: A Guide to Internet Research. If that title came from O'Reilly, Apress, or other big name in tech-publishing, it might be perfectly nice but less interesting. Instead, it was prepared as an internal guide for the NSA, and came to public attention through a FOIA request by MuckRock. (See this video interview with MuckRock's Michael Morisy at this year's SXSW.) The version that's been released is several years old. From Wired's report: "Although the author's name is redacted in the version released by the NSA, Muckrock's FOIA indicates it was written by Robyn Winder and Charlie Speight. A note the NSA added to the book before releasing it under FOIA says that the opinions expressed in it are the authors', and not the agency's. ... Lest you think that none of this is new, that Johnny Long has been talking about this for years at hacker conferences and in his book Google Hacking, you’d be right. In fact, the authors of the NSA book give a shoutout to Johnny, but with the caveat that Johnny’s tips are designed for cracking — breaking into websites and servers. 'That is not something I encourage or advocate,' the author writes." (Hat tip to ThinkGeek's Jacob Rose.)

theodp writes "E-mails and other communications between employees,' explains Google in a newly-published patent application for its Policy Violation Checker invention, 'can implicate potential violations of company policy or local, state or federal law that can go unchecked by attorneys or other legal personnel.' So how can you avoid those embarrassing Goldman Sachs and Enron e-mail gaffes? Use Google's 'methods and systems for identifying problematic phrases in an electronic document'! From the patent application: 'Documents may be used as evidence in court, administrative, or other proceedings. It is in a company's best interest to minimize or eliminate policy violations and/or situations that could give rise to legal liability. It is also often in a company's best interest to be able to Pack [?] these situations. Problematic phrases include, but are not limited to, phrases that present policy violations, have legal implications, or are otherwise troublesome to a company, business, or individual.' So, if you can't Do-No-Evil, at least you can Do-No-Discoverable-Evil!"

First time accepted submitter IamIanB writes "Harvard Middle Eastern Studies student Todd Mostak's first tangle with big data didn't go well; trying to process and map 40 million geolocated tweets from the Arab Spring uprising took days. So while taking a database course across town at MIT, he developed a massively parallel database that uses GeForce Titan GPUs to do the data processing. The system sees 70x performance increases over CPU-based systems, and can out crunch a 1000 node MapReduce cluster, in some cases. All for around $5,000 worth of hardware. Mostak plans to release the system under an open source license; you can play with a data set of 125 million tweets hosted at Harvard's WorldMap and see the millisecond response time." I seem to recall a dedicated database query processor that worked by having a few hundred really small processors that was integrated with INGRES in the '80s.

Nerval's Lobster writes "Twitter is plunging into the online music game. Twitter Music (or "Twitter #music," in the company's own rendering) uses Twitter activity such as Tweets and engagement "to detect and surface the most popular tracks and emerging artists," according to an April 18 posting on Twitter's official blog. Songs on the app derive from three sources: iTunes, Spotify, or Rdio. And yes, Twitter is big, but its victory is by no means assured: other IT giants have entered the same market only to watch highly-publicized projects wither away, doomed by some combination of audience apathy and implementation issues. Take Apple's Ping, for example: launched in September 2010 as part of an iTunes update, the ambitious social-networking and music-recommendation engine immediately ran into a number of problems, including a lack of Facebook integration (despite Steve Jobs' assurances to the contrary) and widespread reports of spam and fake accounts. Can Twitter's effort stand out, or will it just be lost in all the noise?"

adeelarshad82 writes "According to an 18-month study from German independent testing lab AV-Test, searches on Bing returned five times more links to malicious websites than Google searches. The study looked at nearly 40 million websites provided by seven different search engines. About 10 million results came from Bing and another 10 million from Google. 13 million sites were provided by the Russian service Yandex, with the rest coming from Blekko, Faroo, Teoma and Baidu respectively. Of these 40 million sites, AV-Test found 5,000 pieces of malware—and admittedly small percentage of websites."

mallyn writes "This is an article about a search engine that is designed to look for devices on the net that are not really intended to be viewed and used by the general public. Devices include pool filters, skating rink cooling system, and other goodies. 'Shodan runs 24/7 and collects information on about 500 million connected devices and services each month. It's stunning what can be found with a simple search on Shodan. Countless traffic lights, security cameras, home automation devices and heating systems are connected to the Internet and easy to spot. Shodan searchers have found control systems for a water park, a gas station, a hotel wine cooler and a crematorium. Cybersecurity researchers have even located command and control systems for nuclear power plants and a particle-accelerating cyclotron by using Shodan. ... A quick search for "default password" reveals countless printers, servers and system control devices that use "admin" as their user name and "1234" as their password. Many more connected systems require no credentials at all — all you need is a Web browser to connect to them.'"

First time accepted submitter DW100 writes "Microsoft, Nokia and Oracle have taken it upon themselves to moan to the European Commission about Google's Android dominance, which they say is an underhand bid to control the entire mobile market. The firms are part of the FairSearch group, which has just filed a complaint that Google is using Android as a 'Trojan Horse' to take control of the mobile market and all the related advertising revenue. Microsoft would of course know all about this, being at the end of several similar anti-competitive complaints in the past."

theodp writes "Rupert Murdoch's Amplify Education site is all about the kids, so it's understandable that the site's Terms of Use bans abusive, pornographic, obscene, and vulgar content. But if one uses Google to do a site search of Amplify.com (e.g., site:amplify.com donkey) you may get quite an unexpected eye-opener (redacted, but still NSFW). So, does someone at Amplify really want to "@&^$" your "a**"? Of course not. But this does serve as a cautionary tale of the perils of buying a second-hand domain name when pages of the shuttered site may live on in cache-land. Prior to its conversion to a site for kids' education, Amplify.com was a social sharing product that allowed users to clip favorite sites from the web and add their own commentary. Google does note that removed content may still show up in Google's search results in certain situations (removal requests can be made)." Update: 04/08 17:04 GMT by T : Stephanie Chang writes (in a comment below): "Hi, I’m the editor of Amplify.com. We purchased our domain name in February 2012 and took ownership of the site in July 2012 for use as our company's home page. Prior to that, the domain was used by its previous owners as a social-sharing site. As a result, some old content dating back to the previous domain ownership still shows up as cached on certain search engines. Amplify Education, Inc. did not produce the cached content in question nor do we in any way endorse it. We’re working with Google and other search providers to make sure caches of our site are up to date. In the meantime, we apologize to anyone whose attempts to locate information on amplifying donkeys resulted in a negative browsing experience."

another random user sends this excerpt from the BBC: "Two film studios have asked Google to take down links to messages sent by them requesting the removal of links connected to film piracy. Google receives 20 million 'takedown' requests, officially known as DMCA (Digital Millennium Copyright Act) notices, every month. They are all published online. Recent submissions by Fox and Universal Studios include requests for the removal of previous takedown notices. ... By making the notices available, Google is unintentionally highlighting the location of allegedly pirated material, say some experts. 'It would only take one skilled coder to index the URLs from the DMCA notices in order to create one of the largest pirate search engines available,' wrote Torrent Freak editor Ernesto Van Der Sar on the site."

Nerval's Lobster writes "Tech journalist Milo Yiannopoulos asks the question lurking in everyone's mind about Google Glass. 'It's an audacious product for a company no one trusts to behave responsibly with our data: a pair of glasses that can monitor and record the world around you,' he writes. 'But if Glass becomes as ubiquitous as the iPhone, are we truly to believe that Google will not attempt to abuse that remarkable power?' With each new eyebrow-raising court judgment and federal fine levied against Google, he adds, 'it becomes ever more clear that this is a company hell-bent on innovating first and asking questions later, if ever. And its vision, shared with other California technology companies, is of corporate America redefining societal privacy norms in the service of advertising companies and their clients.' He feels that Google will eventually end up in some sort of court battle over Google Glass and privacy. Do you agree? Does Google Glass deserve extra scrutiny before it hits the market?"

coastin writes "The folks at Google Labs have launched a new way to search with Google Nose BETA. The new condensation in search will have you "Coming to your senses" where you can go beyond type, talk, and touch for a new notation of sensation. Get acquainted with Your internet sommelier, expertly curated Knowledge Panels pair images, descriptions, and aromas. Take a whiff of the Google Aromabase — 15M+ scentibytes. Don't ask, don't smell! For when you're wary of your query — SafeSearch included. What's that smell? Google Nose BETA leverages new and existing technologies to offer the sharpest olfactory experience available with: Street Sense (vehicles have inhaled and indexed millions of atmospheric miles), Android Ambient Odor Detection (collects smells via the world's most sensible mobile operating system), and SMELLCD 1.8+ (high-resolution compatible for precise and controlled odors)"

jfruh writes "The Swedish Language Council is a semi-official, government funded body that regulates, cultivates, and tracks changes to the Swedish language. Every year it releases a list of new words that have crept into Swedish, and one of 2012's entries was 'ogooglebar' — 'ungoogleable,' meaning something that can't be found with a search engine. After Google demanded that the definition be changed and the Council add a disclaimer about Google's trademark, the Council has instead decided to remove the word from the list altogether."

Sparrowvsrevolution writes that at this year's SXSW, Defense Distributed founder Code Wilson has announced a for-profit spinoff of his gun-printing project, from which people will be able to search for and download gun-related CAD files. "Though the search engine will index all types of files, Wilson says he hopes the group's reputation for hosting politically incendiary content will mean users trust that it won't censor search results. 'When we say you should have access to these files, people believe we mean that,' says Wilson. 'No takedowns. No removals. We'd fight everything to the full extent of the law.' Along with the SXSW announcement, Wilson also released a provocative video where he lays out the plan for Defcad.com and criticizes gun control advocates and 'collusive' 3D printing companies like Makerbot."

Nerval's Lobster writes "Google senior vice president Amit Singhal, one of the executives heading up the company's search-engine operations, sat down with Guy Kawasaki, former chief evangelist for Apple and author, at one of this year's SXSW keynotes in Austin, TX. 'Our dream is for search to become the "Star Trek" computer, and that's what we're building today,' Singhal said. But he seemed reluctant to share much about his company on a more tactical level, parrying Kawasaki's queries about everything from the amount of code in Google's search platform to recent cyber-attacks on the company's systems. But the two did have an interesting back-and-forth about SEO. 'We at Google have time and time again said—and seen it happen—that if you build high-quality content that adds value, and your readers and your users seek you out, then you don't need to worry about anything else,' Singhal said. 'If people want that content, your site will automatically work you could make a bunch of SEO mistakes and it wouldn't hurt.' When Kawasaki followed up by asking, 'Is SEO bull****?' Singhal replied: 'That would be like saying marketing is bull****.' That drew a laugh from the audience—and maybe some gritted teeth from people who position themselves as SEO experts. The two talked about much more with regard to Google's future plans."

sciencehabit writes "Pharmaceuticals often have side effects that go unnoticed until they're already available to the public. Doctors and even the FDA have a hard time predicting what drug combinations will lead to serious problems. But thanks to people scouring the web for the side effects of the drugs they're taking, researchers have now shown that Google and other search engines can be mined for dangerous drug combinations. In a new study, scientists tried the approach out on predicting hypoglycemia, or low blood sugar. They found that the data-mining procedure correctly predicted whether a drug combo did or did not cause hypoglycemia about 81% of the time."

Nerval's Lobster writes "Facebook's Graph Search, its new and powerful way of searching the social network for all manner of information, has drawn a lot of attention since its January unveiling. Some have praised its innovation; others have wondered openly whether its search abilities will end up threatening Google and LinkedIn. Still more have questioned what it all means for users' privacy—always a touchy subject in conjunction with Facebook. The social network previously revealed how it's adjusting its hardware infrastructure to deal with the spike in traffic that will come from interactions with Graph Search (short answer: the Disaggregated Rack, which will break up hardware resources and scale them independently of one another). Now, in a new blog posting, it's offering a bit more with regard to the software side of things, and how the company repurposed an existing system to solve Graph Search's enormous engineering challenge. Bottom line: Facebook's engineers and executives finally decided on Unicorn, an inverted-index system they'd had in development for quite some time."

concealment writes "Many of us have had the experience of going to Amazon to buy one thing but checking out with a huge shopping cart of items that we didn't initially seek—or even know were available. Amazon's merchandising often benefits Amazon's customers, but trademark owners who lose sales to their competition due to it aren't as thrilled. Fortunately for Amazon, a California federal court recently upheld Amazon's merchandising practices in its internal search results."

First time accepted submitter punk2176 writes "Recently I started a free and open source project known as the PunkSPIDER project and presented it at ShmooCon 2013. If you haven't heard of it, it's at heart, a project with the goal of pushing for improved global website security. In order to do this we built a Hadoop distributed computing cluster along with a website vulnerability scanner that can use the cluster. Once we finished that we open sourced the code to our scanner and unleashed it on the Internet. The results of our scans are provided to the public for free in an easy-to-use search engine. The results so far aren't pretty." The Register has an informative article, too.

taz346 writes "French officials said on Monday that the EU intends to sanction Google after the Internet search giant failed to respond to concerns about its privacy policy. 'At the end of a four-month delay accorded to Google to comply with the European data protection directive and to implement effectively (our) recommendations, no answer has been given,' said France's CNIL data protection agency. Google's new policy, implemented in March 2012, allows it to track users over multiple sites. Users who sign in to Google services cannot opt out. CNIL said a working group would meet next week to begin work on 'coercive actions which should be implemented before the summer' against Google."

9to5Google cites "an extremely reliable source" in reporting that "Google is in the process of building stand-alone retail stores in the U.S. and hopes to have the first flagship Google Stores open for the holidays in major metropolitan areas. The mission of the stores is to get new Google Nexus, Chrome, and especially upcoming products into the hands of prospective customers. Google feels right now that many potential customers need to get hands-on experience with its products before they are willing to purchase. Google competitors Apple and Microsoft both have retail outlets where customers can try before they buy."