open source

Matejmo / Getty Images New languages, and improvements on existing ones, are mushrooming throughout the develoment landscape. Mozilla’s Rust , Apple’s Swift , Jetbrains’s Kotlin , and many other languages provide developers with a new range of choices for speed, safety, convenience, portability, and power. Why now? One big reason is new tools for building languages—specifically, compilers. And chief among them is LLVM , an open source project originally developed by Swift language creator Chris Lattner as a research project at the University of Illinois....

One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because NLP is a diversified field with many distinct tasks, most task-specific datasets contain only a few thousand or a few hundred thousand human-labeled training examples. However, modern deep learning-based NLP models see benefits from much larger amounts of data, improving when trained on millions, or billions, of annotated training examples. To help close this gap in data, researchers have developed a variety of techniques for training general purpose language representation models using the enormous amount of unannotated text on the web (known as pre-training)....