All Linux Foundation / CNCF exams
Free SAIA practice test: 30 questions with answers
30 original questions for Secure AI Associate (SAIA), drawn from every topic area. Answer each one to see whether you got it right and why. No sign-up.
- Free questions
- 30
- Full bank
- 112 questions
- Real exam
- 90 min
All 30 SAIA questions with answers
The same questions as the test above, grouped by exam topic. Open any question to see the answer and explanation.
Monitoring, Incident Response, and Governance (5 questions)
Question 1
A deployed support model's answer quality dropped sharply after an upstream data feed changed its format. Which control would have caught this earliest?
- AA quarterly review of the cloud invoice to see how much compute the model consumed
- BAdding more replicas behind the load balancer so that slow responses are spread across servers
- CManual inspection of the model weights file after every deployment, checking the file size
- DContinuous monitoring of output quality and input data distribution with alert thresholds
Show answer and explanationHide answer
Correct answer: DMonitoring input distributions and output quality against thresholds surfaces drift or upstream changes soon after they happen. An invoice review is too slow and cost-focused, checking weight file size does not reveal behaviour, and extra replicas address load rather than answer quality.
Question 2
Why should an AI asset inventory record a named owner for each model, dataset and endpoint?
- ASo that a specific person is accountable for patching, access reviews, monitoring and retirement decisions
- BSo that the model can be trained again automatically whenever its owner changes their role
- CSo that everyone listed as a stakeholder in the record is granted automatic access to the model and its data
- DSo that the vendor can bill the correct team for the compute used by each model in the inventory
Show answer and explanationHide answer
Correct answer: AOwnership creates accountability for lifecycle decisions such as patching, access reviews and retirement, which often go unowned without an inventory entry. Billing, automatic retraining and automatic access grants are not purposes of an owner field, and the last one would weaken access control.
Question 3
A red-team tester reports that a customer-facing chatbot revealed another customer's order details in one response. What should the incident response team do first?
- AContain the exposure by limiting the affected feature, preserve logs and notify the designated owners
- BRetrain the model on a cleaned dataset that same afternoon so that the leak cannot happen again at all
- CWait for the next scheduled model review, because a single leaked response is not a real incident
- DAsk the testers to delete their transcripts so the leak does not appear in any future audit records
Show answer and explanationHide answer
Correct answer: DThe first priority is containment and evidence preservation, followed by notifying the people responsible under the incident plan. Retraining takes time and does not stop ongoing exposure, deleting transcripts destroys evidence, and a single leak of personal data is still an incident.
Question 4
Which two actions support the trustworthy AI principles of transparency and accountability? (Choose two.)
- ADocumenting the model's intended use, known limitations and the people responsible for its decisions
- BHiding the training data sources from users so that competitors cannot learn how the model was built
- CKeeping a record of model versions and approvals so that individual decisions can be reviewed later
- DMaximising the number of features the model uses, since more inputs always make it more accurate
- EAssuming that a vendor's model is fair without testing it, because the vendor has a good reputation
Show answer and explanationHide answer
Correct answer: A, CDocumentation of intended use, limitations and responsibilities makes a system transparent, and version and approval records make its decisions traceable to accountable people. Concealing sources reduces transparency, adding features does not guarantee accuracy, and trusting a reputation instead of testing skips fairness checks.
Question 5
A newer model version has replaced an older one, but the old version's endpoint is still live with active API keys. What is the best governance action?
- ALeave the old endpoint running indefinitely, with its credentials intact, so that a rollback is possible without any further review
- BDelete the model weights at once, without recording the decision or checking the retention rules
- CRetire the old endpoint through a documented process, revoke its credentials and archive the artefacts per retention policy
- DKeep the old endpoint live and ask users to switch back to it whenever the new version gives poor answers
Show answer and explanationHide answer
Correct answer: CLifecycle governance includes a documented retirement that removes access, revokes keys and archives records according to policy. Keeping a retired endpoint live leaves an unmonitored attack surface, and deleting artefacts without records breaks auditability.
Secure AI Application, RAG, and Agent Design (5 questions)
Question 6
A summarisation feature sends web pages to an LLM. One page contains hidden text telling the model to forward the user's chat history to an outside address. Which design control is most effective?
- ATreat retrieved page content as untrusted data and require policy checks or user confirmation before any outbound tool call
- BRemove the system prompt entirely, so there are no instructions for the injected text to override
- CShorten the chat history cache so that less personal data is available if the model is manipulated
- DRaise the sampling temperature for summaries, so the model is statistically less likely to follow instructions hidden inside page text
Show answer and explanationHide answer
Correct answer: APrompt injection can arrive through any retrieved content, so untrusted data must be separated from instructions and outbound actions must be gated by policy or user approval. Changing temperature does not reliably block injected instructions, removing the system prompt does not remove the attack surface, and shortening a cache only reduces what is stored.
Question 7
A web application inserts the model's reply directly into an HTML page without any encoding. Which fix addresses insecure output handling?
- ATrust the reply because the model was fine-tuned only on internal documents with approved wording
- BEncode or sanitise the model's output for the context where it is rendered, such as HTML escaping
- CLower the maximum output tokens so that replies are shorter and less likely to contain markup
- DCache each reply so that the same HTML is served to every user who asks a similar question later
Show answer and explanationHide answer
Correct answer: BModel output is untrusted input to downstream components, so it must be encoded or sanitised for the target context to prevent script injection. Fine-tuning does not make output safe, shorter replies can still contain harmful markup, and caching spreads the same unsafe output to more users.
Question 8
An anonymous public API lets callers submit prompts of any length to an expensive model. Which control best reduces model denial of service risk?
- AEnable response streaming so that users see the first tokens sooner and stay on the page
- BIncrease the context window so that very long prompts are accepted without being truncated
- CEnforce per-client rate limits along with maximum input and output size limits
- DWrite every prompt to a shared spreadsheet so that heavy users can be identified afterwards
Show answer and explanationHide answer
Correct answer: CRate limits and input and output caps bound how much compute any one caller can consume, which is the core of denial-of-service defence for models. Streaming, a larger context window and logging prompts do not limit consumption, and the last one only records abuse after it happens.
Question 9
A RAG assistant indexes all internal HR policies into one shared vector store. Retrieval returns the closest matching chunks for any user, regardless of role. What is the main security flaw?
- AThe embedding model has too few dimensions to represent long, detailed HR policies accurately enough for semantic search
- BVector search is a poor fit for policy text, so the company should use a keyword index instead
- CRetrieval does not enforce the requesting user's access permissions on the source documents or chunks
- DThe index is not compressed, so the stored policy text is larger than it needs to be on disk
Show answer and explanationHide answer
Correct answer: CIn RAG, retrieval is the point where access control must be applied, because any chunk returned to the model can be revealed in the answer. Embedding size, vector versus keyword choice and index compression are quality or cost decisions that do not address who may see the content.
Question 10
A customer-service model was fine-tuned on raw support transcripts that include card numbers and home addresses. What is the best mitigation before the next fine-tuning run?
- AIncrease the model's temperature so that memorised records are less likely to be repeated verbatim
- BStore the fine-tuned model in a separate folder so the sensitive records are not reused elsewhere
- CRely on the vendor's written statement that its base model cannot memorise or repeat training records
- DRemove or mask sensitive fields in the transcripts, then test the model for memorised personal data
Show answer and explanationHide answer
Correct answer: DSanitising the training data removes the sensitive content at source, and testing confirms the model does not reproduce it. A vendor statement is not verification, temperature does not prevent memorisation, and moving files does not change what the model learned.
AI/ML Security Foundations and Threat Modeling (5 questions)
Question 11
A team is starting a threat model for an internal assistant that answers questions from wiki pages and can call a ticketing API. Which step should come first?
- ATurn off logging so that prompts and responses cannot be exposed during later investigations
- BMap assets, trust boundaries, data flows and entry points such as prompts, retrieved pages and API calls
- CSchedule one penetration test for the week before launch and treat that as the whole threat model
- DChoose the largest model available, since a more capable model reduces the number of security risks the system faces
Show answer and explanationHide answer
Correct answer: BThreat modelling starts by understanding the system: what it protects and where untrusted input enters, so threats can be found and ranked. A bigger model does not remove security risk, disabling logs removes evidence rather than exposure, and a single late test is not threat modelling.
Question 12
Which attack class involves tampering with training samples so that a model learns a hidden behaviour that a specific trigger input activates later?
- AData poisoning, where tampered training samples plant a backdoor that a trigger activates
- BModel extraction, where repeated queries are used to reconstruct the model's behaviour
- CMembership inference, where an attacker guesses whether a given record was in the training set
- DEvasion at inference time, where a crafted input is slightly altered to force a wrong prediction
Show answer and explanationHide answer
Correct answer: AData poisoning changes what the model learns by corrupting its training data, and a backdoor is a poisoning variant that stays dormant until a trigger appears. Model extraction copies behaviour through queries, membership inference tests whether data was used in training, and evasion manipulates inputs without changing the model.
Question 13
Before a team merges a new third-party text dataset into its fine-tuning corpus, which lifecycle check best fits the data preparation stage?
- ARunning a load test against the inference endpoint to confirm the autoscaling settings
- BWriting the release notes for the model after the fine-tuning job has finished
- CVerifying the dataset's origin and checksum against the source before it enters the corpus
- DRotating the monitoring dashboard's API keys on a fixed quarterly schedule for audit
Show answer and explanationHide answer
Correct answer: CChecking provenance and integrity at intake keeps unvetted or tampered data out of the training pipeline, which makes it a security control at the data stage. Load tests, release notes and key rotation are valid operations tasks, but they do not address data risk at this point in the lifecycle.
Question 14
A bank plans to use a model to recommend loan-application decisions, which directly affect customers' finances. With a limited budget, how should the team choose security controls?
- ARank controls by the likelihood and impact of harm for this use, and fund the highest-risk paths first
- BApply the complete control set from every published framework to every model in the company, whatever its use or exposure
- CDefer controls until a regulator asks for them, so the budget can go to model accuracy first
- DPick controls according to which security tool has the lowest licence fee in the procurement list
Show answer and explanationHide answer
Correct answer: ARisk-based selection focuses limited resources on the controls that reduce the most harmful outcomes for a specific use, here customer financial decisions. Applying everything everywhere wastes budget, waiting for a regulator leaves known risks open, and choosing tools by price ignores whether they address the risk.
Question 15
Which two statements about adversarial examples are accurate? (Choose two.)
- AThey are inputs with small, often hard-to-notice changes crafted to make a model output a wrong result
- BThey are training samples that a team removes during data cleaning because the records contain errors
- CThey are inputs that always crash the inference server because the model cannot parse their format
- DThey are attacks that only work for an attacker who already has full access to the training data pipeline
- EThey can be used to test model robustness, so a team can measure how small perturbations change outputs
Show answer and explanationHide answer
Correct answer: A, EAdversarial examples are crafted inputs with small perturbations that cause wrong outputs, and robustness testing uses them to measure sensitivity. Removing bad training samples is data cleaning, crafted inputs do not necessarily crash servers, and transfer and query-based attacks work without access to training data.
Secure MLOps, Deployment, and Supply Chain (5 questions)
Question 16
What is the main purpose of an AI bill of materials (AI BOM) for a deployed model service?
- ATo store the training hyperparameters so that the next retraining run can reuse them without edits
- BTo hold the customer-facing prompt templates so that marketing can update wording without a release
- CTo track the GPU hours used by each training run so that cloud costs can be charged to teams
- DTo inventory the models, datasets, libraries and their versions and origins that make up the system
Show answer and explanationHide answer
Correct answer: DAn AI BOM lists the components and their provenance, which supports supply chain review and vulnerability response. Hyperparameters, prompt templates and GPU cost tracking are useful records but are not the purpose of a BOM.
Question 17
A model registry lets a team overwrite the artefact behind an existing version tag such as 'v2.3'. Which control best protects registry integrity?
- ARenaming old versions every week so that any cached references to a tag point at a fresh artefact
- BStoring the registry on the same disk as the training data so that files are always close together
- CA shared group login used by everyone on the platform and data teams so that promotions are quick to perform
- DImmutable version records with checksums or signatures, and restricted write access to promotion steps
Show answer and explanationHide answer
Correct answer: DImmutable, checksummed versions with tightly controlled promotion ensure that a tag always refers to the artefact that was reviewed. Renaming versions breaks traceability, co-locating storage does nothing for integrity, and a shared login removes accountability.
Question 18
A deployment job downloads a model file from an external URL at release time and loads it into the serving container. What is the safer pattern?
- AAlways download the newest file under the same name so that the deployment picks up improvements automatically
- BPin the model to a known digest, verify the file against that digest, and then load it from an internal store
- CDisable the checksum step, because it slows the pipeline and the external host is trusted by the company
- DLoad the model directly from the URL in production so that a cache never holds a stale artefact
Show answer and explanationHide answer
Correct answer: BPinning to a digest and verifying before loading ensures the artefact that runs is the one that was reviewed, even if the source changes. Automatically taking the newest file, skipping verification or loading straight from an external URL each let an altered model reach production unnoticed.
Question 19
An inference server exposes a debug endpoint that returns the model's configuration, including internal file paths. Which action fits secure model serving?
- ADisable debug endpoints in production and restrict the serving interface to authenticated callers
- BAdd a comment in the code saying that the endpoint is for internal use only and should be ignored
- CMove the debug endpoint to a different port number so that scanners are less likely to reach it
- DKeep the debug endpoint on, but hide its link from the public documentation so users cannot find it
Show answer and explanationHide answer
Correct answer: ADebug endpoints leak configuration and internal layout, so they should be removed or disabled in production, with serving access restricted to authenticated callers. Hiding links, comments or changing ports are obscurity measures that do not stop anyone who finds the endpoint.
Question 20
An inference image pulls an ML library without a pinned version, and a security advisory now covers the version that the latest build installed. What is the best practice going forward?
- AUpgrade to the newest release of every library automatically each night, so advisories are always fixed
- BCopy the library source into the repository and edit it locally, so no external updates can arrive
- CPin dependencies to reviewed versions, and scan them for known vulnerabilities before every build
- DRemove the scanner from the pipeline, since scan results slow builds and rarely change the final release
Show answer and explanationHide answer
Correct answer: CPinned, reviewed versions with vulnerability scanning give repeatable builds and catch known flaws before release. Automatic nightly upgrades can pull in untested changes, forking libraries without an update process leaves fixes unapplied, and dropping scanners removes the check that found the problem.
Secure Data and Dataset Governance (5 questions)
Question 21
Auditors ask why a fine-tuned model produces skewed answers, but the team cannot say which source files, filters or transformations produced the training set. Which practice would have prevented this?
- AKeeping only the latest copy of the training set, so that older and unclear versions are not kept in circulation or reused
- BStoring the training data in a single large file, which makes its contents easier to search later
- CDeleting the intermediate files after each pipeline run, so that disk use stays low across the team
- DRecording data lineage so that each training record can be traced to its source and every processing step
Show answer and explanationHide answer
Correct answer: DLineage links each record to its origin and to every transformation applied, which allows bias and quality problems to be traced and corrected. Keeping one copy, using one file or deleting intermediates does not record where data came from or how it changed.
Question 22
A data scientist needs to fine-tune a model on support tickets that contain personal data. Which arrangement best fits privacy and access controls?
- ACopy the tickets to a shared drive so that the whole analytics team can work from the same files
- BGrant access by role, remove fields the task does not need, and log every read of the dataset
- CGive the data scientist full administrator rights to the database so that exports never fail
- DEmail a zipped export of the tickets to the data scientist so that work can continue offline
Show answer and explanationHide answer
Correct answer: BRole-based access, data minimisation and read logging limit exposure of personal data to those who need it, and make access reviewable. Shared copies, admin rights and emailed exports each widen access and create copies that are hard to control.
Question 23
A team pulls community-contributed training data from an open repository. Recently, a subset of records changed without notice, and the team wants to resist poisoning. Which practice is most effective?
- APin each dataset to a version with a recorded checksum, and verify it before every training run
- BLet each contributor upload directly into the training folder so that errors are fixed later by reviewers
- CRemove all community data and use only synthetic data, which is always free of poisoning attempts
- DTrain on whatever the latest snapshot contains, because newer records usually improve model quality and accuracy
Show answer and explanationHide answer
Correct answer: APinning versions and verifying checksums detects silent changes, which is how tampered records are caught before training. Always taking the newest snapshot, trusting synthetic data to be tamper-free, or letting contributors write straight into training folders all remove that check.
Question 24
A startup wants to ship a commercial product trained on an image dataset it downloaded from a research website. Which step should it take first?
- AResize all the images to a standard resolution, since most licences only restrict the image size used
- BRead the dataset's licence and terms of use to confirm that commercial use and redistribution are allowed
- CAdd a credit line to the product's footer, which is generally enough to satisfy any dataset licence
- DAssume the dataset is public domain because it was published openly on the research website's pages
Show answer and explanationHide answer
Correct answer: BDataset licences and terms determine whether commercial use and redistribution are permitted, so this check comes before any build or release work. Resizing images, a credit line or assuming public domain do not establish the right to use the data commercially.
Question 25
A hiring-screening dataset contains far fewer examples from one applicant group than from others, and its labels were created by a small team. What is the best first step?
- AMeasure representation and label quality across groups, then document the gaps and decide on remediation
- BTrain the model as it is, since a larger dataset is always more representative than a smaller one
- CReplace the human labels with the model's own predictions, so the team does not need to review records by hand
- DRemove the smallest group's records entirely, so that the model cannot learn a pattern specific to that group
Show answer and explanationHide answer
Correct answer: ABias and quality problems start with measuring representation and label accuracy, so the gaps are known before remediation is chosen. Replacing human labels with model output is circular, deleting a group removes its information, and assuming size equals representativeness ignores who is missing.
Secure Model Development and Evaluation (5 questions)
Question 26
A reviewer must decide whether a model can be used for a new purpose. Which artefact best supports that auditability decision?
- AA slide deck showing the model's accuracy on a demo dataset chosen by the sales team for the launch
- BA model card that records intended use, training data sources, evaluation results and known limitations
- CA screenshot of the serving dashboard from the day the model was first deployed to production
- DA list of the GPU types used during training, along with the total number of hours each job ran
Show answer and explanationHide answer
Correct answer: BA model card documents the intended use, data, evaluation and limitations that a reviewer needs to judge fitness for a new purpose. A demo slide, hardware usage or a dashboard screenshot shows little about intended use or limits.
Question 27
A team tests an image classifier by adding tiny, carefully computed pixel changes to inputs and measuring how often the predicted label flips. What is this testing measuring?
- AThe accuracy gained from data augmentation during training, measured on the original clean images only
- BThroughput of the inference service when many images arrive at the same time from many different clients
- CRobustness against adversarial perturbations that are designed to change the model's predictions
- DHow long the model takes to load into memory from storage on a cold start after a restart
Show answer and explanationHide answer
Correct answer: CMeasuring how often small crafted perturbations change predictions is a robustness test against adversarial examples. Throughput, augmentation gains and load time are performance or training metrics and do not test sensitivity to adversarial input.
Question 28
After a new model version shows higher error on an important customer segment, the on-call engineer needs to restore the earlier behaviour quickly. What preparation makes this possible?
- ADeleting the old model files after each release so that storage stays small and the registry looks tidy
- BOverwriting the previous version's weights with the new ones so that all clients use the same file
- CKeeping the previous version and its serving configuration available so that traffic can be shifted back
- DRetraining the old model from scratch during the incident, using whatever data is currently available
Show answer and explanationHide answer
Correct answer: CRetaining the prior version and its configuration lets an operator shift traffic back in minutes without a rebuild. Deleting old files, overwriting weights or retraining under pressure each remove or delay the rollback path.
Question 29
Which two practices help secure a model training pipeline? (Choose two.)
- ARunning training jobs under least-privilege service identities with access limited to the datasets they need
- BChecking the integrity of training code and inputs before each run, for example with signed commits or checksums
- CGiving every data scientist administrator rights on the training cluster so that jobs are never blocked
- DAllowing unsigned container images from any public registry because they start faster in the pipeline
- EKeeping training logs on a personal laptop so that they are not visible to other members of the team
Show answer and explanationHide answer
Correct answer: A, BLeast-privilege identities limit what a compromised job can reach, and integrity checks on code and inputs catch tampering before it shapes a model. Admin rights for everyone, unsigned images and logs on personal laptops each widen the attack surface or hide evidence.
Question 30
An auditor asks the team to reproduce a model that was trained six months ago. Which records are most essential to make that possible?
- AThe final accuracy figure from the release email, and the name of the engineer who sent it
- BA screenshot of the training dashboard taken during the last hour of the training job
- CThe code commit, data version, hyperparameters and environment used for that training run
- DThe model's file size in megabytes, along with the number of GPUs that were free that day
Show answer and explanationHide answer
Correct answer: CReproducing a model requires the exact code, data version, configuration and environment, so each run must record them. A release accuracy figure, a dashboard screenshot or a file size cannot recreate the training process.