Search references for DATASET SHIFT. Phrases containing DATASET SHIFT
See searches and references containing DATASET SHIFT!DATASET SHIFT
Change in data distribution between training and deployment in machine learning
Dataset shift is a phenomenon in machine learning and statistics in which the joint distribution of input variables and target labels is different in
Dataset_shift
Series of language models developed by Google AI
reason not all selected tokens are masked is to avoid the dataset shift problem. The dataset shift problem arises when the distribution of inputs seen during
BERT_(language_model)
These datasets are used in machine learning (ML) research and have been cited in peer-reviewed academic journals. Datasets are an integral part of the
List of datasets for machine-learning research
List_of_datasets_for_machine-learning_research
Database of handwritten digits
original datasets. The creators felt that since NIST's training dataset was taken from American Census Bureau employees, while the testing dataset was taken
MNIST_database
This is a list of datasets for machine learning research. It is part of the list of datasets for machine-learning research. These datasets consist primarily
List of datasets in computer vision and image processing
List_of_datasets_in_computer_vision_and_image_processing
Change in wavelength of light
"The 2dF galaxy redshift survey: Power-spectrum analysis of the final dataset and cosmological implications". Monthly Notices of the Royal Astronomical
Redshift
Artificial intelligence field of study
Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift". NeurIPS. arXiv:1906.02530. Bogdoll, Daniel; Breitenstein, Jasmin;
AI_safety
languages are mainly based on the definitions used by UNESCO. UNESCO's dataset was completed in 2010 and has not been updated since. In order to be listed
Lists_of_endangered_languages
review of spam email detection: analysis of spammer strategies and the dataset shift problem". Artificial Intelligence Review. 56 (2): 1145–1173. doi:10
Applications of artificial intelligence
Applications_of_artificial_intelligence
Tasks in machine learning
ISBN 978-3-642-35289-8. "Machine learning - Is there a rule-of-thumb for how to divide a dataset into training and validation sets?". Stack Overflow. Retrieved 2021-08-12
Training, validation, and test data sets
Training,_validation,_and_test_data_sets
Image dataset
The CIFAR-10 dataset (Canadian Institute For Advanced Research) is a collection of images that are commonly used to train machine learning and computer
CIFAR-10
Class of nonparametric methods
Covariate shift and local learning by distribution matching. In J. Quinonero-Candela, M. Sugiyama, A. Schwaighofer, N. Lawrence (eds.). Dataset shift in machine
Kernel embedding of distributions
Kernel_embedding_of_distributions
Process supporting machine learning
or tagging relevant metadata within a dataset to enable machines to interpret the data accurately. The dataset can take various forms, including images
Data_annotation
Type of large language model
learning architecture called the transformer. They are pre-trained on large datasets of unlabeled content, and able to generate novel content. OpenAI was the
Generative pre-trained transformer
Generative_pre-trained_transformer
Mathematical technique
Mean shift is a non-parametric feature-space mathematical analysis technique for locating the maxima of a density function, a so-called mode-seeking algorithm
Mean_shift
Landsat-based dataset of global tree cover change
Global Forest Change dataset, also known as Hansen Global Forest Change or simply Global Forest Change, is a global remote sensing dataset of tree cover extent
Global_Forest_Change_dataset
the Global Study on Homicide are based on the UNODC Homicide Statistics dataset, which is derived from the criminal justice or public health systems of
List of countries by intentional homicide rate
List_of_countries_by_intentional_homicide_rate
Vector quantization algorithm minimizing the sum of squared deviations
adopted in early machine learning and data analysis tasks involving large datasets. Despite its widespread use, limitations such as sensitivity to initial
K-means_clustering
Field associated with machine learning and transfer learning
labeled in another. Prior Shift (Label Shift) occurs when the label distribution differs between the source and target datasets, while the conditional distribution
Domain_adaptation
Technique in neural networks for learning joint representations of text and images
To train a pair of CLIP models, one would start by preparing a large dataset of image-caption pairs. During training, the models are presented with
Contrastive Language–Image Pre-training
Contrastive_Language–Image_Pre-training
Type of machine learning model
question. Some datasets are adversarial, focusing on problems that confound LLMs. One example is the TruthfulQA dataset, a question answering dataset consisting
Large_language_model
Restrictions on using GPS in China
conversion methods both ways largely renders obsolete datasets for deviations mentioned below. The China GPS shift (or offset) problem is a class of issues stemming
Restrictions on geographic data in China
Restrictions_on_geographic_data_in_China
Machine learning technique
collection models, where the model is learning by interacting with a static dataset and updating its policy in batches, as well as online data collection models
Reinforcement learning from human feedback
Reinforcement_learning_from_human_feedback
2018 text-generating language model
labeled data. This reliance on supervised learning limited their use of datasets that were not well-annotated, in addition to making it prohibitively expensive
GPT-1
Artificial intelligence research collective
to GPT-3. On December 31, 2020, EleutherAI released The Pile, a curated dataset of diverse text for training large language models. While the paper referenced
EleutherAI
Subset of artificial intelligence
partition a dataset into a specified number of clusters, k, each represented by the centroid of its points. This process condenses extensive datasets into a
Machine_learning
Measure of similarity between two data clusterings
Example of two similar clusterings of the same dataset, produced by k-means and mean shift. The adjusted Rand index between them is A R I ≈ 0.94 {\displaystyle
Rand_index
Technique for the generative modeling of a continuous probability distribution
process for a given dataset, such that the process can generate new elements that are distributed similarly as the original dataset. A diffusion model
Diffusion_model
2023 text-generating language model
code models. Granite models are trained on datasets curated from Internet, academic publishings, code datasets, legal and finance documents. A foundation
IBM_Granite
Evolution of a word's meaning
Google Books n-gram dataset and the Corpus of Historical American English (COHA). Database of Semantic Shifts in languages of the world (DatSemShift 3.0)
Semantic_change
Operations research problem, paradigm of constrained scheduling problems
on 20 March 2014, retrieved 20 March 2014 "Global Shift Scheduling & Labor Law Compliance Dataset". Daywatch Research. 2026. Retrieved 2026-06-11. Aickelin
Nurse_scheduling_problem
Modem for computers released by AT&T in 1962
followed the introduction of the 110 baud Bell 101 dataset in 1958. The Bell 103 modem used audio frequency-shift keying to encode data. Different pairs of audio
Bell_103
Type of feedforward neural network
etc.) Robust datasets also increase the probability that CNNs will learn the generalized principles that characterize a given dataset rather than the
Convolutional_neural_network
Neural network that learns efficient data encoding in an unsupervised manner
the reference distribution is just the empirical distribution given by a dataset { x 1 , . . . , x N } ⊂ X {\displaystyle \{x_{1},...,x_{N}\}\subset {\mathcal
Autoencoder
Government digital portal in Saudi Arabia
Artificial Intelligence Authority (SDAIA). It provides public access to datasets released by various government entities in standardized, reusable formats
Open.data.gov.sa
Country in Southeast Europe
2025. ISSN 1840-104X. Retrieved 20 December 2025. "Bosnia and Herzegovina Datasets". IMF. Archived from the original on 29 December 2025. Retrieved 18 March
Bosnia_and_Herzegovina
Social networking service owned by Meta Platforms
Analytica controversy. A Facebook spokeswoman said in a statement: "The dataset is old and appears to have information obtained before we made changes
Algorithm for modelling sequential data
adopted for training large language models (LLMs) on large (language) datasets. Modern transformer designs are commonly grouped into encoder-only, decoder-only
Transformer_(deep_learning)
Similarity measure for number sequences
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Cosine_similarity
error and possibly confirmation bias, although modern reanalysis of the dataset suggests that Eddington's analysis was accurate. The measurement was repeated
Tests_of_general_relativity
Approach in generative models
of a target dataset and generates a similar but larger dataset. EBMs detect the latent variables of a dataset and generate new datasets with a similar
Energy-based_model
Method in machine learning
dataset. The original dataset is whatever information is given. The bootstrap dataset is made by randomly picking objects from the original dataset.
Bootstrap_aggregating
Flaw in mathematical modelling
fitted relationship will appear to perform less well on a new dataset than on the dataset used for fitting (a phenomenon sometimes known as shrinkage)
Overfitting
Type of database that uses vectors to represent other data
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Vector_database
Type of artificial intelligence system
Training used three datasets: The LTIP dataset mentioned above, a curated dataset of video-text pairs (called VTP), and a massive dataset of interleaved text-image
Vision–language_model
Country in North Africa
March 2024. Retrieved 3 March 2024. V-Dem Institute (2023). "The V-Dem Dataset". Archived from the original on 8 December 2022. Retrieved 14 October 2023
Egypt
Artificial intelligence model paradigm
sound, etc.), is a machine learning or deep learning model trained on vast datasets so that it can be applied across a wide range of use cases. Generative
Foundation_model
Important algorithms in numerical statistics
print(ab.get_sample_variance()) This algorithm allows one to divide a dataset into several pieces, run them in parallel, and then merge the results together
Algorithms for calculating variance
Algorithms_for_calculating_variance
Human-caused changes to climate on Earth
in climate have had no precedent for several thousand years. Multiple datasets all show worldwide increases in surface temperature, at a rate of around
Climate_change
2023 text-generating language model
given large datasets of text taken from the internet and trained to predict the next token (roughly corresponding to a word) in those datasets. Second, human
GPT-4
Mathematical technique in spectroscopic analysis
adapted accordingly. Suppose the original dataset D contains the n spectra in rows. The signals of the original dataset are generally preprocessed. The original
Two-dimensional correlation analysis
Two-dimensional_correlation_analysis
Influential 2012 deep convolutional neural network
performing over 2,200 forward passes per second under ideal conditions. The dataset images were stored in JPEG format. They took up 27GB of disk. The neural
AlexNet
Tree-based ensemble machine learning methods
\mathbf {x} } , designed with randomness Θ j {\displaystyle \Theta _{j}} and dataset D n {\displaystyle {\mathcal {D}}_{n}} , and N n ( x , Θ j ) = ∑ i = 1
Random_forest
Type of feedforward neural network
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Multilayer_perceptron
American multinational technology conglomerate
2005. In 2021, it rebranded as Meta Platforms, Inc. to reflect a strategic shift toward developing the metaverse—an interconnected digital ecosystem spanning
Meta_Platforms
Deep learning architecture
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Mamba (deep learning architecture)
Mamba_(deep_learning_architecture)
Field of machine learning
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Reinforcement_learning
Method used to normalize the range of independent variables
Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift". arXiv:1502.03167 [cs.LG]. Juszczak, P.; D. M. J. Tax; R. P. W. Dui (2002)
Feature_scaling
Algorithm for supervised learning of binary classifiers
is proved by Rosenblatt et al. Perceptron convergence theorem—Given a dataset D {\textstyle D} , such that max ( x , y ) ∈ D ‖ x ‖ 2 = R {\textstyle
Perceptron
Academic conference in machine learning
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
International Conference on Machine Learning
International_Conference_on_Machine_Learning
2025 multimodal model by OpenAI
learning from human feedback. Pretraining used a large-scale multilingual dataset of books, articles, web pages, academic papers, and licensed sources. GPT-5's
GPT-5
Ensemble learning method
BrownBoost, can learn from noisy datasets and can specifically learn the underlying classifier of the Long–Servedio dataset. Random forest Alternating decision
Boosting_(machine_learning)
Data visualization
box-and-whisker diagram. Outliers that differ significantly from the rest of the dataset may be plotted as individual points beyond the whiskers on the box plot
Box_plot
Model-free reinforcement learning algorithm
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Proximal_policy_optimization
Deep learning method
known dataset serves as the initial training data for the discriminator. Training involves presenting it with samples from the training dataset until
Generative adversarial network
Generative_adversarial_network
Country in South Asia
Broadcasting Corporation 2009. Rediff 2008 a. Reuters 2010. Curry 2010. "India Datasets". International Monetary Fund. Retrieved 15 April 2026. Sawhney, Anoushka
India
Machine learning technique
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Mixture_of_experts
Iterative method for finding maximum likelihood estimates in statistical models
algorithm fitting a two component Gaussian mixture model to the Old Faithful dataset. The algorithm steps through from a random initialization to convergence
Expectation–maximization algorithm
Expectation–maximization_algorithm
Machine learning methods using multiple input modalities
and image tokens. The compound model is then fine-tuned on an image-text dataset. This basic construction can be applied with more sophistication to improve
Multimodal_learning
Concept in machine learning
entries across dataset splits is also important. For language models, the Min-K% method can detect the presence of data in a pretraining dataset. It presents
Leakage_(machine_learning)
2020 text-generating language model
its parameter count and dataset size increased by a factor of 10. It had 1.5 billion parameters, and was trained on a dataset of 8 million web pages.
GPT-3
Historic cartel in the coal industry
article. Dale 1922, p. 820. Dunn 1844, p. 18. Cromar 1977, pp. 86–7. In a dataset of 532 historical markets, Connor found the Limitation of the Vend was
Limitation_of_the_Vend
Act of violence committed in support of environmental causes
until the mid-2000s when it increasingly shifted to civil disobedience and mass protests. Large-N datasets have found very few instances of fatalities
Eco-terrorism
Country in West Asia
Bank Open Data". World Bank Open Data. Retrieved 10 March 2025. "Iran Datasets". IMF. Retrieved 10 March 2025. Wehrey, Frederic; Green, Jerrold D.; Nichiporuk
Iran
Method of improving artificial neural network
normalization works so well. It was initially thought to tackle internal covariate shift, a problem where parameter initialization and changes in the distribution
Batch_normalization
Country within the United Kingdom
Archived from the original on 10 April 2023. Retrieved 7 January 2024. "Datasets – UK Civil Aviation Authority". Caa.co.uk. Retrieved 3 January 2019.[dead
Scotland
Reverse-engineering neural networks
articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline
Mechanistic_interpretability
Machine learning technique where agents learn from demonstrations
straying far from the path. DAgger (Dataset Aggregation) improves on behavior cloning by iteratively training on a dataset of expert demonstrations. In each
Imitation_learning
Wetlands in India as per Ramsar list
Information System (GIS) technology, with paired pre-monsoon and post-monsoon datasets to capture seasonal variability. Ramsar Convention List of Ramsar Sites
List_of_Ramsar_sites_in_India
Class of algorithms for pattern analysis
clusters, rankings, principal components, correlations, classifications) in datasets. For many algorithms that solve these tasks, the data in raw representation
Kernel_method
Process of analyzing large data sets
mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless
Data_mining
Machine learning-powered structure design
Barret Zoph and Quoc Viet Le applied NAS with RL targeting the CIFAR-10 dataset and achieved a network architecture that rivals the best manually-designed
Neural_architecture_search
resurfacing of damaged articulating joints. 8 August Researchers provide a dataset of standardized calculated detailed environmental impacts of >57,000 circulating
2022_in_science
Family of large language models by Alibaba
the Apache 2.0 License, although only the weights were released, not the dataset or training method. QwQ has a 32K token context length and performs better
Qwen
Density-based data clustering algorithm
DBSCAN can find non-linearly separable clusters. This dataset cannot be adequately clustered with k-means or Gaussian Mixture EM clustering.
DBSCAN
Intelligence of machines
on several mathematical benchmarks, including 84% accuracy on the MATH dataset of competition mathematics problems. In January 2025, Microsoft proposed
Artificial_intelligence
ophiacodontids, edaphosaurids and sphenacodontids, based on an updated dataset from the study of Didier & Laurin (2024), is published by Laurin et al
2026_in_paleontology
2019 text-generating language model
in their foundational series of GPT models. GPT-2 was pre-trained on a dataset of 8 million web pages. It was partially released in February 2019, followed
GPT-2
3D reconstruction technique
require a specialized camera or software. Any camera is able to generate datasets, provided the settings and capture method meet the requirements for SfM
Neural_radiance_field
Method in natural language processing
embeddings may contain the biases and stereotypes contained in the trained dataset, as Bolukbasi et al. points out in the 2016 paper "Man is to Computer Programmer
Word_embedding
Machine learning technique
Out-of-bag estimates help avoid the need for an independent validation dataset, but often underestimate actual performance improvement and the optimal
Gradient_boosting
Concept involving online bot activity
interaction. In 2023, the company moved to charge for access to its user dataset. Companies training AI are expected to continue to use this data for training
Dead_Internet_theory
Conversational software
responses word by word based on user input, and are usually trained on a large dataset of natural-language phrases. They sometimes provide plausible-sounding
Chatbot
Long-term weather pattern of a region
Archived from the original on 13 January 2026. Click on "Datasets". Natural driver dataset is downloadable by clicking on "gmst_changes_model_and_obs
Climate
Video-sharing platform
September 30, 2025. Elias, Jennifer (September 26, 2025). "How Google shifted from a bastion of accurate information to a steward of free expression"
YouTube
American artificial intelligence company
notable involvement from OpenAI's president, Greg Brockman. The resulting dataset proved instrumental in training GPT-4. In February 2024, The Intercept
OpenAI
Method of measuring prediction error
samples and OOB sets are created. The OOB sets can be aggregated into one dataset, but each sample is only considered out-of-bag for the trees that do not
Out-of-bag_error
Set of methods for supervised statistical learning
Cortes and Vapnik in 1993 and published in 1995. We are given a training dataset of n {\displaystyle n} points of the form ( x 1 , y 1 ) , … , ( x n , y
Support_vector_machine
Natural satellite orbiting Earth
Views of the Moon: Integrated Remotely Sensed, Geophysical, and Sample Datasets: 69. Bibcode:1998nvmi.conf...69S. Spudis, Paul D.; Reisse, Robert A.; Gillis
Moon
Effect of variables' uncertainties on the uncertainty of a function based on them
sampling techniques from the Monte Carlo method family. For very large datasets or complex functions, the calculation of the error propagation may be very
Propagation_of_uncertainty
DATASET SHIFT
DATASET SHIFT
Male
Greek
(Αἴολος) Greek name AIOLOS means "sparkling; quick-shifting; quick-moving." In mythology, this is the name of the god of winds.Â
Surname or Lastname
English and German
English and German : from a Germanic personal name, either a short form of compound names such as Billard, or else a byname Bill(a), from Old English bil ‘sword’, ‘halberd’ (or a Continental cognate). (Bill as a short form of William was not used until the 17th century.)English : metonymic occupational name for a maker of pruning hooks and similar implements, from Middle English bill, from Old English bil ‘sword’, with the meaning shifted to a more peaceful agricultural application (see Biller 5).
Surname or Lastname
English
English : from Middle English persone, parsoun ‘parish priest’, ‘parson’ (Old French persone, from Latin persona ‘person’, ‘character’), hence a status name for a parish priest or perhaps a nickname for a devout man. The reasons for the semantic shift from ‘person’ to ‘priest’ are not certain; the most plausible explanation is that the local priest was regarded as the representative person of the parish. The phonetic change from -er- to -ar- was a regular development in Middle English.Americanized form of one or more like-sounding Jewish names.Americanized spelling of Swedish Pärsson, Persson (see Persson).
Surname or Lastname
English
English : from Middle English smoc, smok ‘smock’, ‘shift’, hence a metonymic occupational name for someone who made or sold such garments, or a nickname for someone who habitually wore a smock (the usual everyday working garment of a peasant).
Male
Scandinavian
Scandinavian name derived from Old Norse hamr, HEMMING means "shape." The name may have originated as a byname for a "shape-shifter" or "werewolf."
Female
Finnish
Finnish myth name from the Kalevala, possibly LOUHI means "trance." Louhi was a queen of Pohjola, and a witch with the ability to shape-shift and cast powerful magic spells.Â
Male
Greek
Variant spelling of Greek Aiolos, AEOLOS means "sparkling; quick-shifting; quick-moving."
Male
Welsh
Welsh Arthurian legend name of a Knight of the Round Table best remembered as the lover of Esyllt (French: Tristan and Iseult). But the earliest texts hint at a character who was far more than just a lover; he was a master of deception and had the ability to shape-shift, a definite attribute of a trickster. In the Cymric Trioedd, Esyllt is his uncle's wife; with the help of the swineherd, Drystan arranges for a secret tryst with her, but Arthur shows up unexpectedly wanting to steal some of his uncle's swine, and Drystan somehow outwits the Forever King.     The name has been associated with Latin tristis "sad," referring to the tragic fate of the young "lover." It has been linked with Pictish drust of unknown DRYSTAN means, and Celtic drest, "riot, tumult." The latter comes closest to fitting his true character; compare with Old English þr�st/þrÃste: "bold, daring, rash, audacious," and even "shameless."Â
Surname or Lastname
English
English : occupational name for a servant, Middle English ladde. The word first appeared in the 13th century, with the meaning ‘servant’ or ‘man of humble birth’, the modern meaning of ‘young man’, ‘boy’ being a later shift.Most American bearers of this name trace their ancestry to a certain Daniel Ladd, who emigrated from London to Ipswich, MA, in 1634.
DATASET SHIFT
DATASET SHIFT
Girl/Female
Hindu
Hundred years, It means a period of years century
Girl/Female
Muslim
Beloved
Boy/Male
German, Polish
Famous Landowner
Boy/Male
Tamil
The cupid, The God of Love
Biblical
a yearling bull
Girl/Female
Hindu, Indian
Lord Vishnu; Ocean
Female
English
Feminine form of English unisex Merle, MERLA means "blackbird."
Girl/Female
Indian, Telugu
Desire
Boy/Male
Tamil
Marked by spear
Girl/Female
Arabic, Muslim
Kindness; Sympathy
DATASET SHIFT
DATASET SHIFT
DATASET SHIFT
DATASET SHIFT
DATASET SHIFT
v. t.
To exchange for another of the same class; to remove and to put some similar thing in its place; to change; as, to shift the clothes; to shift the scenes.
a.
Admitting of being shifted.
n.
An arrangement for shifting a belt sidewise from one pulley to another.
a.
Adapted or used for shifting anything.
a.
Shifting.
v. t.
The change of one set of workmen for another; hence, a spell, or turn, of work; also, a set of workmen who work in turn with other sets; as, a night shift.
v. i.
To change direction; to turn; to shift; as, wind veers to the west or north.
v. t.
Something frequently shifted; especially, a woman's under-garment; a chemise.
a.
Changing in place, position, or direction; varying; variable; fickle; as, shifting winds; shifting opinions or principles.
n.
The quality or state of being shifty.
a.
Destitute of expedients, or not using successful expedients; characterized by failure, especially by failure to provide for one's own support, through negligence or incapacity; hence, lazy; improvident; thriftless; as, a shiftless fellow; shiftless management.
imp. & p. p.
of Shift
a.
Full of, or ready with, shifts; fertile in expedients or contrivance.
v. t.
The act of shifting.
v. t.
To change the place of; to move or remove from one place to another; as, to shift a burden from one shoulder to another; to shift the blame.
adv.
In a shifting manner.
n.
One who, or that which, shifts; one who plays tricks or practices artifice; a cozener.
p. pr. & vb. n.
of Shift
n.
An assistant to the ship's cook in washing, steeping, and shifting the salt provisions.
v. t.
To change the position of; to alter the bearings of; to turn; as, to shift the helm or sails.