Skip to content
Applied Singularity

Applied Singularity

The network for AI, Bio, Robotics and IoT professionals

  • Home
  • Activities
    • Quiz
    • Ideathon
  • Services
    • Hiring Services
  • Blog
  • Get the App!
    • Terms & Conditions
    • Privacy Policy
  • Gallery

Tag: long-term dependency

NLP Tutorials — Part 12: Transformer-XL

Welcome back to yet another interesting article in our NLP Tutorials series. In this article we will be talking about Transformer-XL which outperformed the Vanilla Transformer (Attention is All You Need) in accuracy metrics and handling long-term context dependencies which we often see in real world tasks. 

Featured Postdeeplearning, long-term dependency, nlp, recurrence, transformer-xl, transformersLeave a comment

@A6Singularity

My Tweets

Follow us on your favorite Social Media!

RSS Feed for our Blogs

RSS Feed

  • Meetup (Bangalore)
  • Meetup (Mumbai)
  • Facebook
  • LinkedIn
  • Twitter
  • Instagram
  • Telegram
Create a website or blog at WordPress.com
  • Follow Following
    • Applied Singularity
    • Already have a WordPress.com account? Log in now.
    • Applied Singularity
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar