Introduction to LLM and generative AI test guide 2024

What is generative AI Branch of AI which creates new content (in text, images, audio, or other forms of media) What is generative AI good for? Creativity and innovation Learn from data Diverse apllications What is an important subset of Generative AI? GAN: Generative Adversarial Network What does GAN consist of? Twor neural networks: Generator Discriminator Go to models for handling sequential data? RNNs: Recurrent Neural Networks LSTMs: Long Short-Term memory Network refers to? Specific architecture of neural networks designed for processing sequence of data, time series, sentences, audio Transformer models Brought a shift, relying on attention mechanism allowing it to process input data in parallel to handle long range dependencies efficiently Development of transformer models led to? LLM: Large language models What improves the models ability to encode language? Self attention and the ability to learn a tension. What are large language models? Advanced AI models trained to understand and generate human language Challenges in LLM? Handling biases in training data and ensuring ethical use. Transformer model refers to? The architecture of a model Foundational model Big toolbox can be used for many things Large Language Model Special set of tools in the toolbox (foundational model) specifically for understanding and using language Parameters in a LLM refer to? Internal variables used to process and generate text, the more parameters the better. Token Basic unit of text. Can be a word, part of a word or punctuation. Context window Maximum span of text the model can consider when processing input and generating responses