Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
Check out the new SourceForge HTML5 internet speed test! No Flash necessary and runs on all devices. ×
AI Google Science

Google Brain Researchers Make Significant Progress On Language Modeling (arxiv.org) 32

New submitter integralclosure writes: Using neural networks, Google Brain researchers have significantly improved a computer's ability to model English (achieving extremely low perplexity score on a large dataset). Using the model they were able to generate random sentences, such as the following: 'Yuri Zhirkov was in attendance at the Stamford Bridge at the start of the second half but neither Drogba nor Malouda was able to push on through the Barcelona defence.' The sentences are generally coherent and mostly grammatically correct. Advances seem to be a replay of neural networks' dominance in the Imagenet competition.
This discussion has been archived. No new comments can be posted.

Google Brain Researchers Make Significant Progress On Language Modeling

Comments Filter:
  • Perplexity (Score:5, Funny)

    by Geoffrey.landis ( 926948 ) on Friday February 12, 2016 @12:54PM (#51495013) Homepage

    "achieving extremely low perplexity score on a large dataset"

    That's quite an achievement, since I have a very high perplexity score on that sentence.

    Do they check whether it achieves low perplexity only when the sentence is not, in fact, perplexing?

    • if you read the article, you would know that the perplexity score is related to how perplexing something is, and the dataset is the number of examples of sentences.

    • I have the same issue with this one: Yuri Zhirkov was in attendance at the Stamford Bridge at the start of the second half but neither Drogba nor Malouda was able to push on through the Barcelona defence.

      .
      WTF? Sounds like chess.

      • by Anonymous Coward

        Football, well soccer.

        Stamford Bridge is the home ground of Chelsea. Drogba used to play for them. Dunno who Malouda was but Zhirkov was a Russian player who I don't think ever played for either Chelsea or Barcelona.

        • Football, well soccer.

          Stamford Bridge is the home ground of Chelsea. Drogba used to play for them. Dunno who Malouda was but Zhirkov was a Russian player who I don't think ever played for either Chelsea or Barcelona.

          Oh, I though that was describing the technical breakthrough. ;-)

          Made no sense at all.

        • Florent Malouda was French and did play for Chelsea, as well as Lyon.
    • by Anonymous Coward

      After reading this, http://www.zonalmarking.net/2011/03/01/chelsea-2-1-man-utd-tactics/ [zonalmarking.net], the sentence "Yuri Zhirkov was in attendance at the Stamford Bridge at the start of the second half but neither Drogba nor Malouda was able to push on through the Barcelona defence." doesn't seem like much of an accomplishment. SubReddit Simulator [reddit.com] produces as much.

      • Posting to undo incorrect moderation. ^^This looks to be a very informative lecture on the topic, for any other mods who may come along.
  • by Coisiche ( 2000870 ) on Friday February 12, 2016 @01:00PM (#51495067)

    'Yuri Zhirkov was in attendance at the Stamford Bridge at the start of the second half but neither Drogba nor Malouda was able to push on through the Barcelona defence.'

    Barcelona playing at Stamford Bridge? That hasn't happened for years!

  • by Anonymous Coward

    They should hook this up to the Firehose and have it edit Slashdot stories.

  • F and U shouldn't be that perplexing than?
  • by presidenteloco ( 659168 ) on Friday February 12, 2016 @01:36PM (#51495333)

    Time flies like an arrow. Fruit flies like a banana.

    • Time flies like an arrow. Fruit flies like a banana.

      That's an ill-formed utterance though. Clever joke, but not really real English.

      • by rwven ( 663186 )

        I think it's still a very useful thing to be able to understand though. English is absolutely loaded with ill-formed utterances in order to impart humor, sarcasm, intent, etc. It'll be very important for artificial systems to be able to reproduce and understand things like these.

        • That's a HIGHLY advanced function, though. For right now, it's far better to focus on correctly interpreting and generating meaningful, well-formed English. More casual language can come much later.
      • by Anonymous Coward

        Time flies like an arrow. Fruit flies like a banana.

        That's an ill-formed utterance though. Clever joke, but not really real English.

        Wrong. It's not a joke and it's perfectly legitimate English. Admitedly, it's an absurd statement, but that's the point.

  • Yuri Zhirkov was in attendance at the Stamford Bridge

    it's just "Stamford Bridge", not "the Stamford Bridge".

    Try again!

  • "The sentences are generally coherent and mostly grammatically correct," which means nobody will believe they are talking to a person.

    I thought they said the program improved language modeling.

All extremists should be taken out and shot.

Working...