Skip to content

Repository files navigation

NLP

Basic Definitions

Named Entity Recognition

NE's are definite noun phrases that refer to specific types of individuals, such as organizations, persons, dates, and so on. The Goal of NER system is to identify all textual mentions of the named entities. This can be broken down into two suctask: Identifying the boundarie of the NE, and identifying its type. It can attrubute to Question Answering.

Embeddings

Embeddings measure the relatedness of text strings. Embeddings are commonly used for search, clustering, recommendations, animaly detection, diversity measurement and classification. An embedding is a vector (list) of floating point numbers. The distance between two vectors measures their relatednedd. Small distances suggest high relatedness ad large distances suggest low relatedness.

BERT

Bidirectional Encoder Representations from Transformers

  • It uses only encoders (12 transformer encoder layers)
  • Bidirectional links connecting the “lanes” between layers
  • Trained on ≈ 3.3 Billion words (Wikipedia & Google Books corpus)
  • Created with transfer learning in mind:
    • Trained on 2 simple unsupervised tasks (for which lots of data is available)
    • Can be fine-tuned for numerous complex tasks (for which few labeled data are available)
  • Due to the transformer’s attention mechanism, we get contextualization “for free

Sentinemt Analysis

The process of analyzing digita; text to determine if the emotional tine of the messasge os positive, negative, or neutral. Sentiment analysis tools can scan this text to autimitacally determine the author's attitude woeards a topic. Companies use the insights from sentiment analysis improve cutomer service and increase brand reputation.

https://aws.amazon.com/what-is/sentiment-analysis


About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages