AI & Data: glossary terms

Artificial intelligence, machine learning and data terms for anyone trying to follow the conversation.

शब्दकोश · AI और डेटाA/B TestingA/B testing is a controlled experiment that shows two versions of a page or feature to different users to learn which performs better on a chosen metric.शब्दकोश · AI और डेटाAGI (Artificial General Intelligence)AGI is a hypothetical form of artificial intelligence able to learn and perform any intellectual task a human can, rather than excelling only at narrow tasks.शब्दकोश · AI और डेटाAI AgentAn AI agent is a system built around a language model that plans steps, calls tools or APIs, and acts toward a goal with limited human direction.शब्दकोश · AI और डेटाAI AlignmentAI alignment is the research and engineering effort to make AI systems pursue the goals and values their designers and users actually intend.शब्दकोश · AI और डेटाAI BenchmarkAn AI benchmark is a standardized test set and scoring method used to compare models on a task, such as reasoning, coding, or question answering.शब्दकोश · AI और डेटाAI HallucinationAn AI hallucination is output from a model that sounds confident and plausible but is factually wrong, fabricated, or unsupported by its sources.शब्दकोश · AI और डेटाAI ModelAn AI model is the trained mathematical system, defined by its architecture and learned parameters, that turns inputs into predictions or generated content.शब्दकोश · AI और डेटाAlgorithmic Bias (Bias in AI)Algorithmic bias is systematic, unfair skew in an AI system's outputs, usually arising from unrepresentative data, flawed labels, or design choices.शब्दकोश · AI और डेटाArtificial Intelligence (AI)Artificial intelligence is the field of building software that performs tasks normally needing human judgment, such as perceiving, reasoning, and language.शब्दकोश · AI और डेटाBackpropagationBackpropagation is the algorithm that computes how much each weight in a neural network contributed to the error, so gradient descent can update them.शब्दकोश · AI और डेटाBatch SizeBatch size is the number of training examples a model processes before updating its weights once, affecting speed, memory use and training stability.शब्दकोश · AI और डेटाBig DataBig data describes datasets so large, fast-moving, or varied that ordinary single-machine tools struggle, requiring distributed storage and processing.शब्दकोश · AI और डेटाBusiness Intelligence (BI)Business intelligence is the practice and tooling for collecting, analysing and presenting business data in reports and dashboards to support decisions.शब्दकोश · AI और डेटाChain of ThoughtChain of thought is a prompting approach where a language model writes out intermediate reasoning steps before answering, often helping multi-step problems.शब्दकोश · AI और डेटाChatbotA chatbot is a program that converses with users in natural language through text or voice, from simple scripted menus to AI-powered assistants.शब्दकोश · AI और डेटाClassification (Machine Learning)Classification is a supervised learning task where a model assigns each input to one of a set of predefined categories, such as spam or not spam.शब्दकोश · AI और डेटाClusteringClustering is an unsupervised learning method that groups similar data points together without predefined labels, revealing natural segments in the data.शब्दकोश · AI और डेटाComputer VisionComputer vision is the field of AI that enables machines to interpret images and video, for tasks like object detection, face matching, and text reading.शब्दकोश · AI और डेटाContext WindowThe context window is the maximum amount of text, measured in tokens, that a language model can consider at once, covering both your input and its reply.शब्दकोश · AI और डेटाCorrelation vs CausationCorrelation means two variables move together, while causation means one produces a change in the other; correlation alone does not prove causation.शब्दकोश · AI और डेटाCosine SimilarityCosine similarity measures how alike two vectors are by the cosine of the angle between them, ranging from -1 to 1 regardless of vector length.शब्दकोश · AI और डेटाCSV (Comma-Separated Values)CSV is a plain-text file format that stores tabular data with one record per line and fields separated by commas, widely used to exchange spreadsheet data.शब्दकोश · AI और डेटाDashboard (Data)A dashboard is a single screen that visualizes key metrics and charts so people can monitor performance and spot problems at a glance.शब्दकोश · AI और डेटाData AnalyticsData analytics is the process of examining data to find patterns and answer questions, typically summarizing what happened, why, and what to do next.शब्दकोश · AI और डेटाData CleaningData cleaning is the process of finding and fixing errors, duplicates, missing values, and inconsistencies in a dataset before analysis or modeling.शब्दकोश · AI और डेटाData GovernanceData governance is the set of policies, roles and processes defining who can use which data, how, and how its quality, security and compliance are kept.शब्दकोश · AI और डेटाData LabelingData labeling is the process of tagging raw data such as images, text or audio with correct answers so supervised models can learn from it.शब्दकोश · AI और डेटाData LakeA data lake is a storage repository that holds large volumes of raw data in its original format, structured or unstructured, until it is needed.शब्दकोश · AI और डेटाData PipelineA data pipeline is an automated series of steps that moves data from sources through processing to a destination, such as a database, warehouse, or model.शब्दकोश · AI और डेटाData ScienceData science is the discipline of extracting insight and predictions from data by combining statistics, programming, and domain knowledge.शब्दकोश · AI और डेटाData WarehouseA data warehouse is a central database optimized for analytics that stores cleaned, structured data from many sources for reporting and querying.शब्दकोश · AI और डेटाDatasetA dataset is an organized collection of related data, usually arranged as rows and columns, used for analysis, reporting, or training machine learning models.शब्दकोश · AI और डेटाDecision TreeA decision tree is a model that predicts outcomes by asking a sequence of yes or no questions about features, branching until it reaches a final answer.शब्दकोश · AI और डेटाDeep LearningDeep learning is a type of machine learning that uses neural networks with many layers to learn complex patterns from large amounts of data.शब्दकोश · AI और डेटाDiffusion ModelA diffusion model generates data such as images by learning to reverse a gradual noising process, turning random noise into a coherent output step by step.शब्दकोश · AI और डेटाEmbeddingAn embedding is a list of numbers that represents the meaning of text, an image, or other data so that similar items sit close together in vector space.शब्दकोश · AI और डेटाEpochAn epoch is one complete pass of the entire training dataset through a machine learning model during training.शब्दकोश · AI और डेटाETL (Extract, Transform, Load)ETL is a data integration process that extracts data from sources, transforms it into a consistent form, and loads it into a target such as a warehouse.शब्दकोश · AI और डेटाFew-Shot PromptingFew-shot prompting puts a handful of worked input and output examples in the prompt so a language model can infer the task and format without retraining.शब्दकोश · AI और डेटाFine-TuningFine-tuning is the process of further training a pre-trained model on a smaller, task-specific dataset so it adopts a particular style, format, or skill.शब्दकोश · AI और डेटाFunction Calling (Tool Use)Function calling, or tool use, lets a language model return a structured request to run a named function, so an application can fetch data or take actions.शब्दकोश · AI और डेटाGAN (Generative Adversarial Network)A GAN is a generative model in which a generator and a discriminator network compete, pushing the generator to produce increasingly realistic synthetic data.शब्दकोश · AI और डेटाGenerative AIGenerative AI refers to models that create new content such as text, images, audio, video, or code by learning patterns from existing data.शब्दकोश · AI और डेटाGPU (Graphics Processing Unit)A GPU is a processor with thousands of small cores built for parallel math, now the standard hardware for training and running AI models.शब्दकोश · AI और डेटाGradient DescentGradient descent is an optimisation algorithm that repeatedly adjusts model parameters in the direction that lowers the loss, using the loss function's slope.शब्दकोश · AI और डेटाGuardrails (AI)AI guardrails are checks and rules placed around a model's inputs and outputs to keep behaviour safe, on-topic and compliant with policy.शब्दकोश · AI और डेटाHistogramA histogram is a chart that shows the distribution of a numeric variable by counting how many values fall into consecutive ranges called bins.शब्दकोश · AI और डेटाInference (AI)Inference is the stage where a trained AI model is run on new input to produce a prediction or generated output, as opposed to the training stage.शब्दकोश · AI और डेटाKnowledge GraphA knowledge graph stores facts as entities and the typed relationships between them, so software can query connections and reason over linked data.शब्दकोश · AI और डेटाLLM (Large Language Model)A large language model is a neural network trained on vast text to predict the next token, so it can write, summarize, translate, and answer questions.शब्दकोश · AI और डेटाLoss FunctionA loss function is a formula that scores how wrong a model's predictions are, giving the training process a single number to minimise.शब्दकोश · AI और डेटाMachine Learning (ML)Machine learning is a method where algorithms learn patterns from data to make predictions or decisions without being explicitly programmed with rules.शब्दकोश · AI और डेटाMean vs MedianThe mean is the arithmetic average of values, while the median is the middle value when sorted; the median resists outliers and skew far better.शब्दकोश · AI और डेटाMetadataMetadata is data that describes other data, such as a file's author, creation date, size, or format, helping systems and people find and interpret it.शब्दकोश · AI और डेटाModel DistillationModel distillation trains a smaller student model to imitate the outputs of a larger teacher model, keeping much of its quality at lower cost and latency.शब्दकोश · AI और डेटाModel ParametersModel parameters are the numeric values, mainly weights and biases, that a machine learning model learns during training and uses to turn inputs into outputs.शब्दकोश · AI और डेटाMultimodal AIMultimodal AI refers to models that can process and sometimes generate more than one type of data, such as text, images, audio, and video.शब्दकोश · AI और डेटाNeural NetworkA neural network is a machine learning model made of layers of connected nodes whose numeric weights are adjusted during training to map inputs to outputs.शब्दकोश · AI और डेटाNLP (Natural Language Processing)Natural language processing is the field of AI concerned with enabling computers to read, interpret, and generate human language in text or speech.शब्दकोश · AI और डेटाOpen-Weight ModelAn open-weight model has its trained parameters published for download so anyone can run or adapt it, though training data and code may stay closed.शब्दकोश · AI और डेटाOutlierAn outlier is a data point that lies unusually far from the rest of the values, caused by error, rare events or genuine extreme behaviour.शब्दकोश · AI और डेटाOverfittingOverfitting happens when a model memorizes noise and quirks of its training data, scoring well on that data but poorly on new, unseen examples.शब्दकोश · AI और डेटाP-ValueA p-value is the probability of results at least as extreme as those observed if the null hypothesis were true; it is not the chance the hypothesis is true.शब्दकोश · AI और डेटाPromptA prompt is the input text or instruction given to an AI model, such as a question, command, or example, that tells it what output to produce.शब्दकोश · AI और डेटाPrompt EngineeringPrompt engineering is the practice of designing and refining instructions, context, and examples so an AI model produces reliable, useful output.शब्दकोश · AI और डेटाQuantizationQuantization reduces a model's memory and compute needs by storing its weights, and sometimes activations, with fewer bits, such as 8-bit or 4-bit numbers.शब्दकोश · AI और डेटाRAG (Retrieval-Augmented Generation)Retrieval-augmented generation is a technique that fetches relevant documents and adds them to a prompt so a language model answers from supplied sources.शब्दकोश · AI और डेटाRandom ForestA random forest is an ensemble model that trains many decision trees on random samples of data and features, then combines their votes or averages.शब्दकोश · AI और डेटाRecommendation SystemA recommendation system predicts which items a user is likely to want, such as products, videos or articles, using behaviour, content and similarity signals.शब्दकोश · AI और डेटाRegression (Machine Learning)Regression is a supervised learning task where a model predicts a continuous numeric value, such as a price or response time, from input features.शब्दकोश · AI और डेटाRLHF (Reinforcement Learning from Human Feedback)RLHF is a training method that tunes a language model using human preference rankings of its outputs, so replies become more helpful and better aligned.शब्दकोश · AI और डेटाSampling (Statistics)Sampling is selecting a subset of a population to study so that conclusions about the whole group can be drawn without measuring every member.शब्दकोश · AI और डेटाSemantic SearchSemantic search finds results by meaning rather than exact keywords, typically by comparing vector embeddings of the query and the documents.शब्दकोश · AI और डेटाSpeech RecognitionSpeech recognition, or speech-to-text, is technology that converts spoken audio into written text using acoustic and language models.शब्दकोश · AI और डेटाStandard DeviationStandard deviation measures how spread out values are around their mean, in the same units as the data; a larger value means more variability.शब्दकोश · AI और डेटाStructured vs Unstructured DataStructured data fits a fixed schema of rows and columns, while unstructured data such as text, images, and audio has no predefined tabular format.शब्दकोश · AI और डेटाSupervised LearningSupervised learning trains a model on labeled examples, where each input has a known correct answer, so it can predict labels for new, unseen data.शब्दकोश · AI और डेटाSynthetic DataSynthetic data is artificially generated information that mimics the statistical patterns of real data, used for testing, privacy protection and model training.शब्दकोश · AI और डेटाSystem PromptA system prompt is a set of instructions given to a language model ahead of user messages that defines its role, tone, rules and constraints for a conversation.शब्दकोश · AI और डेटाTemperature (Sampling)Temperature is a sampling setting for language models that scales how random the next-token choice is: low values are predictable, high values are more varied.शब्दकोश · AI और डेटाText-to-Speech (TTS)Text-to-speech converts written text into spoken audio using synthesis models, used for assistants, accessibility, navigation and narration.शब्दकोश · AI और डेटाToken (AI)In language models, a token is a small chunk of text, often a word piece, that the model reads and generates, and the unit used to measure length and cost.शब्दकोश · AI और डेटाTokenizationTokenization is the process of splitting text into tokens, such as words, subwords or characters, that a language model converts into numbers and processes.शब्दकोश · AI और डेटाTop-p (Nucleus Sampling)Top-p, or nucleus sampling, limits a language model's next-token choice to the smallest set of tokens whose combined probability reaches a threshold p.शब्दकोश · AI और डेटाTraining DataTraining data is the collection of examples a machine learning model learns from, whose quality, coverage, and labeling largely determine the model's behavior.शब्दकोश · AI और डेटाTransformer (AI Architecture)The transformer is a neural network architecture using self-attention to weigh relationships across an input, and it underlies most modern language models.शब्दकोश · AI और डेटाTuring TestThe Turing test, proposed by Alan Turing in 1950, judges a machine intelligent if a person cannot reliably tell it from a human in conversation.शब्दकोश · AI और डेटाUnsupervised LearningUnsupervised learning finds hidden structure in unlabeled data, such as groups of similar items or unusual outliers, without being given correct answers.शब्दकोश · AI और डेटाVector DatabaseA vector database stores embeddings and quickly finds the ones most similar to a query vector, enabling semantic search and retrieval for AI applications.शब्दकोश · AI और डेटाZero-Shot PromptingZero-shot prompting asks a language model to perform a task using only instructions, with no worked examples included in the prompt.