googlenlp

An Interface to Google's Cloud Natural Language API

BrianWeinstein
8
1
R

output: github_document

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "README-"
)

googlenlp

Travis-CI Build Status CRAN status Download count

The googlenlp package provides an R interface to Google’s Cloud Natural Language API.

“Google Cloud Natural Language API reveals the structure and meaning of text by offering powerful machine learning models in an easy to use REST API. You can use it to extract information about people, places, events and much more, mentioned in text documents, news articles or blog posts. You can use it to understand sentiment about your product on social media or parse intent from customer conversations happening in a call center or a messaging app.” [source]

There are four main features of the API, all of which are available through this R package [source]:

  • Syntax Analysis: “Extract tokens and sentences, identify parts of speech (PoS) and create dependency parse trees for each sentence.”
  • Entity Analysis: “Identify entities and label by types such as person, organization, location, events, products and media.”
  • Sentiment Analysis: “Understand the overall sentiment expressed in a block of text.”
  • Multi-Language: “Enables you to easily analyze text in multiple languages including English, Spanish and Japanese.”

Resources

Installation

The current googlenlp release can be installed from CRAN:

install.packages("googlenlp")

The newest development release can be installed from GitHub:

# install.packages('devtools')
devtools::install_github("BrianWeinstein/googlenlp")

Authentication

To use the API, you’ll first need to create a Google Cloud project and enable billing, and get an API key.

Configuration

Load the package and set your API key. There are two ways to do this.

Method A (preferred)

Method A (preferred method) adds your API key as a variable to your .Renviron file. Under this method, you only need to do this setup process one time.

library(googlenlp)

configure_googlenlp() # follow the instructions printed to the console

googlenlp setup instructions:
 1. Your ~/.Renviron file will now open in a new window/tab.
    *** If it doesn't open, run:  file.edit("~/.Renviron") ***
 2. To use the API, you'll first need to create a Google Cloud project and enable billing (https://cloud.google.com/natural-language/docs/getting-started).
 3. Next you'll need to get an API key (https://cloud.google.com/natural-language/docs/common/auth).
 4. In your  ~/.Renviron  file, replace the ENTER_YOUR_API_KEY_HERE with your Google Cloud API key.
 5. Save your ~/.Renviron file.
 6. *** Restart your R session for changes to take effect. ***

Method B

Method B defines your API key as a session-level variable. Under this method, you’ll need to set your API key at the beginning of each R session.

library(googlenlp)

set_api_key("MY_API_KEY") # replace this with your API key

Getting started

devtools::load_all("~/Documents/googlenlp")
library(dplyr)

Define the text you’d like to analyze.

text <- "Google, headquartered in Mountain View, unveiled the new Android phone at the Consumer Electronic Show.
         Sundar Pichai said in his keynote that users love their new Android phones."

The annotate_text function analyzes the text’s syntax (sentences and tokens), entities, sentiment, and language; and returns the result as a five-element list.

analyzed <- annotate_text(text_body = text)

str(analyzed, max.level = 1)

Sentences

“Sentence extraction breaks up the stream of text into a series of sentences.” [API Documentation]

  • beginOffset indicates the (zero-based) character index of where the sentence begins (wtih UTF-8 encoding).
  • The magnitude and score fields quantify each sentence’s sentiment — see the Document Sentiment section for more details.
analyzed$sentences

knitr::kable(analyzed$sentences, format = "markdown")

Tokens

“Tokenization breaks the stream of text up into a series of tokens, with each token usually corresponding to a single word.
The Natural Language API then processes the tokens and, using their locations within sentences, adds syntactic information to the tokens.” [API Documentation]

  • lemma indicates the token’s “root” word, and can be useful in standardizing the word within the text.
  • tag indicates the token’s part of speech.
  • Additional column definitions are outlined here and here.
analyzed$tokens

knitr::kable(analyzed$tokens, format = "markdown")

Entities

“Entity Analysis provides information about entities in the text, which generally refer to named ‘things’ such as famous individuals, landmarks, common objects, etc… A good general practice to follow is that if something is a noun, it qualifies as an ‘entity.’” [API Documentation]

  • entity_type indicates the type of entity (i.e., it classifies the entity as a person, location, consumer good, etc.).
  • mid provides a “machine-generated identifier” correspoding to the entity’s Google Knowledge Graph entry.
  • wikipedia_url provides the entity’s Wikipedia URL.
  • salience indicates the entity’s importance to the entire text. Scores range from 0.0 (less important) to 1.0 (highly important).
  • Additional column definitions are outlined here.
analyzed$entities

knitr::kable(analyzed$entities, format = "markdown")

Document sentiment {#document-sentiment}

“Sentiment analysis attempts to determine the overall attitude (positive or negative) expressed within the text. Sentiment is represented by numerical score and magnitude values.” [API Documentation]

  • score ranges from -1.0 (negative) to 1.0 (positive), and indicates to the “overall emotional leaning of the text”.
  • magnitude “indicates the overall strength of emotion (both positive and negative) within the given text, between 0.0 and +inf. Unlike score, magnitude is not normalized; each expression of emotion within the text (both positive and negative) contributes to the text’s magnitude (so longer text blocks may have greater magnitudes).”

A note on how to interpret these sentiment values is posted here.

analyzed$documentSentiment

knitr::kable(analyzed$documentSentiment, format = "markdown")

Language

language indicates the detected language of the document. Only English (“en”), Spanish (“es”) and Japanese (“ja”) are currently supported by the API.

analyzed$language