About Nothing Breaks Like A.I. Heart

The article delves into the complexities of human relationships and emotions, juxtaposed with the capabilities of artificial intelligence, specifically the GPT-3 model. The author shares a personal narrative about a relationship with “Omar” and how it intertwined with her experiences with GPT-3. The story is filled with moments of introspection, humor, and the challenges of navigating love and heartbreak.

Features of GPT-3

  1. Generative Pre-trained Transformer: GPT-3, developed by OpenAI, is a language model designed to predict sequences of words based on user-provided prompts. For instance, given a prompt like “Hello my name,” the model might suggest the next word as “is.”
  2. Size and Scope: GPT-3 boasts 175 billion parameters, making it one of the largest publicly available models of its kind. It’s trained on vast amounts of data from the internet and books, enabling it to generate diverse and contextually relevant content.
  3. Learning from the Internet: The model has been trained on countless sentences and stories from the web. If you’ve ever written something on platforms like Reddit, there’s a likelihood that GPT-3 has encountered it.
  4. Lack of Self-awareness: Despite its vast knowledge, GPT-3 lacks self-awareness. It can generate content based on prompts without any personal bias or emotion, making it a neutral tool for content generation.
  5. Potential for Toxicity: GPT-3 can sometimes reflect the biases and toxicity present in the data it was trained on. However, efforts are made to cherry-pick generations to minimize exposure to harmful content.
  6. Overfitting Tendency: One of the challenges with GPT-3 is its tendency to “overfit” or get trapped in repetitive language loops. This can sometimes make the generated content feel redundant or overly repetitive.

Additional Features

  1. Few-shot Learning: GPT-3 can be prompted with a headline or a few samples of desired content, allowing it to generate relevant and contextually appropriate content based on those samples.
  2. Influence on Writing Style: The author notes that writing alongside GPT-3 can sometimes influence one’s style. The generated content and the author’s original writing might converge over time, making it challenging to differentiate between the two.
  3. Power of Suggestion: GPT-3’s outputs can be so compelling that they might sway the author’s perspective or understanding of a situation. This highlights the model’s potential influence on human thought processes.