All IBM exams
Free IBM Certified watsonx Generative AI Engineer - Associate practice test: 30 questions with answers
30 original questions for IBM Certified watsonx Generative AI Engineer - Associate, drawn from every topic area. Answer each one to see whether you got it right and why. No sign-up.
- Free questions
- 30
- Full bank
- 112 questions
IBM Certified watsonx Generative AI Engineer - Associate exam guide: topics, cost and format
All 30 IBM Certified watsonx Generative AI Engineer - Associate questions with answers
The same questions as the test above, grouped by exam topic. Open any question to see the answer and explanation.
Designing a Generative AI Solution (8 questions)
Question 1
A team wants a generative AI assistant that answers questions about its internal policy documents. Which requirement should be defined first?
- AThe number of GPUs that will be bought, so that the hardware budget is fixed before any requirements are gathered
- BThe colour scheme of the chat window, so that the interface matches the corporate brand guidelines used on the intranet
- CThe business question the assistant must answer, the users who will ask it, and the accuracy and risk tolerance for its answers
- DThe name of the foundation model, which should be chosen first because every other design decision depends on it
Show answer and explanationHide answer
Correct answer: CDefining the business question, users, and tolerance for error shapes every later decision, including model choice, retrieval design, and evaluation. Colour schemes, GPU purchases, and a pre-chosen model are downstream decisions that should follow from those requirements.
Question 2
Which factor most influences whether a generative AI use case should use a general-purpose foundation model or a smaller specialized model?
- AThe required quality, latency, cost, and data residency constraints of the specific use case being designed
- BThe size of the company's office, since larger offices can justify larger models while smaller offices cannot
- CThe popularity of the model on social media, which indicates that the model is the best choice for every task
- DThe age of the employees who will use the assistant, since younger users need general models and older users need small ones
Show answer and explanationHide answer
Correct answer: AQuality, latency, cost, and data residency requirements decide whether a general model or a smaller specialized one fits the use case. Office size, social media popularity, and user age do not determine the technical fit.
Question 3
What is the purpose of a success metric defined before building a generative AI solution?
- ATo set the price of the model's API calls that the finance team will charge back to the business units each month
- BTo give the team a measurable way to judge whether the solution meets the business need, both before and after release
- CTo decide which programming language the developers must use for the frontend of the application they are building
- DTo determine the number of employees who must be trained on the tool before its launch in the organization each year
Show answer and explanationHide answer
Correct answer: BA success metric gives an objective basis for evaluating the solution against business goals, which keeps decisions honest. Pricing, programming language, and training counts are important but do not define success.
Question 4
Which design decision is most appropriate when the generated answers must be traceable to approved source documents?
- ARemoving the document collection entirely so that the model cannot copy text and so the answers stay original
- BAsking the model to answer from its general knowledge only, since traceability is achieved by the model's training data
- CGrounding the model's responses in retrieved passages from the approved document collection and showing the sources
- DAllowing the model to generate citations from memory without retrieving any documents at the time of each question
Show answer and explanationHide answer
Correct answer: CGrounding answers in retrieved approved passages and showing their sources makes each answer traceable to a verifiable origin. Relying on general knowledge, removing documents, and inventing citations from memory all break the link to approved sources.
Question 5
Which risk should be addressed when a generative AI solution will process customer personal data?
- AThe speed of the document upload progress bar, which is the main factor that determines whether users trust the system
- BData protection obligations, including what data is sent to the model, where it is processed, and how long it is kept
- CThe number of words in the model's response, which is the main source of exposure of personal data to outside parties
- DThe choice of font in the user interface, which determines whether personal information is visible to other users
Show answer and explanationHide answer
Correct answer: BPersonal data needs controls on what is sent to the model, where it is processed, and how long it is retained. Upload progress, response length, and font choices do not determine the exposure of personal data.
Question 6
Which two design considerations help a team decide between using prompting alone and customizing a model? (Choose two.)
- AWhether the required behaviour can be achieved reliably with clear instructions and a few examples in the prompt
- BWhether the task needs a consistent style or specialized vocabulary that prompting alone cannot maintain well
- CWhether the team prefers the colour of the logo of the model vendor, since brand preference should drive the choice
- DWhether the model's name is easy to pronounce, because the team must say it aloud in every design meeting it holds
- EWhether the marketing team has already printed brochures that mention a particular model, which fixes the choice
Show answer and explanationHide answer
Correct answer: A, BPrompting can often reach the goal with instructions and examples, while customization becomes worthwhile when consistent style or specialized vocabulary is needed. Logo colour, pronunciation, and printed brochures have no bearing on the technical choice.
Question 7
Which two activities belong in the evaluation plan for a generative AI solution? (Choose two.)
- ADefining test cases that reflect the real questions users will ask and the risks that matter most to the business
- BChoosing the model's name for the marketing launch so that the public recognizes the product quickly on release
- CMeasuring answer quality against a reference set of expected answers that the subject experts have reviewed
- DDeciding where the team will sit in the office during the project so that the people involved can communicate
- EPrinting the test results on paper and filing them, so that the evidence is available for later auditing reviews
Show answer and explanationHide answer
Correct answer: A, CRealistic test cases and measurement against expert-reviewed reference answers are what make an evaluation plan informative. Marketing names, seating, and printed results do not test whether the solution answers correctly.
Question 8
Why should the data used by a generative AI project be classified before any design work begins?
- AClassification determines the number of words that the model will generate in each answer it returns to the user
- BClassification sets the font and colour scheme of the application's screens so that users can recognize sensitive items
- CClassification determines which data may be sent to a model, where it may be processed, and what controls apply to it
- DClassification decides which developer is allowed to name the project in the team's tracker, based on seniority
Show answer and explanationHide answer
Correct answer: CClassifying data decides whether it may go to a model and what handling it needs, which constrains the whole design. Fonts, answer length, and naming rights do not depend on how sensitive the data is.
Selecting and Customizing Foundation Models (8 questions)
Question 9
What is the main difference between prompt tuning and fine-tuning a foundation model?
- AFine-tuning requires no training data at all, whereas prompt tuning requires a large labelled dataset of many thousands of examples
- BFine-tuning changes only the user interface of the application, whereas prompt tuning changes the weights of the base model
- CPrompt tuning deletes the base model and replaces it with a new one trained from random values, which fine-tuning does not do
- DPrompt tuning learns a small set of trainable prompt parameters while the base model stays frozen, whereas fine-tuning updates the model's weights
Show answer and explanationHide answer
Correct answer: DPrompt tuning keeps the base model frozen and learns a small set of prompt parameters, while fine-tuning updates weights of the model itself. Interface changes, replacing the model, and the data requirements in the other options reverse or misstate these differences.
Question 10
When is fine-tuning most likely to be preferred over prompt engineering alone?
- AWhen the model's responses must be shorter than ten words in every case, regardless of the complexity of the question asked
- BWhen the team wants to avoid writing any instructions at all, so that the model learns everything from its own experience
- CWhen the application will only ever be used once, so that the cost of training a model is spread over a single use
- DWhen the application needs consistent behaviour, format, or domain language that prompting alone does not reliably produce
Show answer and explanationHide answer
Correct answer: DFine-tuning is worth its cost when consistent behaviour, format, or specialized language cannot be achieved reliably through prompting. Avoiding instructions, one-time use, and fixed short answers do not justify training a model.
Question 11
What is a foundation model?
- AA large model trained on broad data that can be adapted to many downstream tasks through prompting or further training
- BA model that is designed to work only for one specific task, such as classifying invoices, and cannot be adapted to others
- CThe physical server rack on which a model is hosted, which provides the foundation for the cloud infrastructure in use
- DA sample dataset that is used only to check that the data pipeline runs without errors before any model is trained
Show answer and explanationHide answer
Correct answer: AFoundation models are broadly trained and adaptable to many tasks, which is why they are the base for customization. A single-task model, a server rack, and a sample dataset do not match the term.
Question 12
Which practice helps a team choose a foundation model for a specific generative AI use case?
- AChoosing the model that the most people on social media are discussing, since popularity signals the best quality
- BChoosing the model that has the largest number of parameters, since bigger models always perform best on every task
- CEvaluating candidate models on a representative set of the team's own tasks, measuring quality, latency, and cost
- DChoosing the model with the newest release date, since newer models are always better suited to every business need
Show answer and explanationHide answer
Correct answer: CTesting candidates on the team's own representative tasks with quality, latency, and cost measured gives evidence for the choice. Parameter count, social media popularity, and release date are not reliable substitutes for that evidence.
Question 13
What is the purpose of a labelled dataset when customizing a model through supervised tuning?
- AIt lists the names of the users who will be allowed to access the model after it has been deployed to production
- BIt stores the model's hyperparameters so that they can be reused by another team in a later training run
- CIt provides example inputs paired with the desired outputs, which teaches the model the behaviour the team wants
- DIt records the invoices paid by the team during the tuning project so that the cost can be tracked by finance
Show answer and explanationHide answer
Correct answer: CSupervised tuning learns from input and desired output pairs, so the labels are the examples of the behaviour being taught. Hyperparameter storage, access lists, and invoice records are different artifacts.
Question 14
Which description best defines a hallucination in a generative model?
- AFluent, confident output that is factually incorrect or not supported by the context or sources the model was given
- BA visual error in the chat window that makes the text on the screen overlap with the buttons used to submit requests
- CA backup copy of the model that is stored on a separate server so that the service can recover from a hardware failure
- DA scheduled retraining job that runs automatically each night to refresh the model's weights with the latest data
Show answer and explanationHide answer
Correct answer: AHallucination is output that sounds credible but is inaccurate or unsupported, which is why generated answers need grounding and checks. Interface overlap, backups, and retraining schedules are unrelated to this failure mode.
Question 15
Which two factors indicate that a model customization is ready to be considered for deployment? (Choose two.)
- AThe tuned model performs better than the base model on a held-out evaluation set that was not used in tuning
- BThe tuned model has been tested only on the examples that were used to train it, which shows its full ability
- CThe tuning run has been recorded with its data version, settings, and evaluation results so it can be reproduced
- DThe tuned model has been named after the project sponsor, which signals that the sponsor has approved the work
- EThe tuned model's output has been accepted by one colleague who liked the tone of the answers on a single day
Show answer and explanationHide answer
Correct answer: A, CImprovement on held-out data and a reproducible record of the run are the evidence that supports deployment. Testing only on training examples, naming the model after a sponsor, and one colleague's approval are not valid readiness checks.
Question 16
What is instruction tuning?
- AWriting a user manual for the application that explains each of the buttons and menus that are shown on the screens
- BTraining a model on examples of instructions paired with desired responses so that it follows user instructions more reliably
- CChanging the model's name in the registry so that users can find it more easily when they search for it in the catalogue
- DSetting the operating system clock on the server that hosts the model so that the timestamps in the logs are correct
Show answer and explanationHide answer
Correct answer: BInstruction tuning uses instruction and response pairs to improve how the model follows directions. User manuals, registry names, and server clocks are unrelated to training behaviour.
Prompting and Retrieval-Augmented Generation (7 questions)
Question 17
What is retrieval-augmented generation (RAG)?
- ATraining a model from scratch on random data so that its outputs are not influenced by any particular source
- BA pipeline that retrieves relevant passages from a knowledge source and supplies them to the model to ground its answer
- CA cache of images that the interface loads so that the pages of the application are displayed more quickly to users
- DA printing method that places the generated text on the page in a layout chosen by the user before each print run
Show answer and explanationHide answer
Correct answer: BRAG retrieves relevant passages at query time and gives them to the model, which grounds the answer in a source. Training from scratch on random data, printing layouts, and image caches are unrelated to this pattern.
Question 18
Why are documents split into chunks when a RAG index is built?
- AChunks make the generated answer print faster on the output device, which is the main reason they are used in practice
- BChunks compress all of the documents into a single number that is stored in the index so that search is very fast
- CChunks remove the need for metadata, because each chunk carries all of the information the system will need later on
- DChunks are small enough to embed and retrieve precisely, while still carrying enough context to be useful to the model
Show answer and explanationHide answer
Correct answer: DChunking balances precision in retrieval against enough surrounding context for the answer to make sense. Compressing documents into one number, removing metadata, and print speed are not reasons for chunking.
Question 19
What does an embedding model do in a RAG pipeline?
- AConverts text into vectors so that passages with similar meaning can be located by a similarity search
- BEncrypts the source documents so that they can be stored safely in the knowledge base without being readable
- CGenerates the final answer that is shown to the user after the retrieved passages have been supplied to it
- DStores the usernames and passwords of the people who are allowed to ask questions of the system in the index
Show answer and explanationHide answer
Correct answer: AAn embedding model maps passages and queries into a shared vector space, which makes semantic search possible. Encryption, answer generation, and credential storage are separate functions in the system.
Question 20
Which prompting technique asks the model to work through an explicit sequence of steps before it gives the final answer?
- ARandom prompting, in which the words of the instruction are shuffled so that the model explores more possibilities
- BSilent prompting, in which the instruction is sent to the model without any visible reasoning or explanation returned
- CChain-of-thought prompting, in which the model is asked to reason step by step before stating its final answer
- DCompressed prompting, in which the instruction is shortened to the fewest possible tokens to reduce the cost per call
Show answer and explanationHide answer
Correct answer: CChain-of-thought prompting asks the model to show intermediate reasoning, which often helps on multi-step problems. Shuffled, silent, and compressed prompts do not request step-by-step reasoning.
Question 21
What is a common cause of irrelevant passages being retrieved in a RAG system?
- AA slow monitor on the analyst's desk, which delays the display of the results but does not change which results are found
- BPoor chunking or weak query processing that does not match the way the content is written in the source documents
- CThe colour of the answer text that the interface displays, which can make some results harder to read for some users
- DA large number of users who are asking questions at the same time, which changes the meaning of the passages retrieved
Show answer and explanationHide answer
Correct answer: BChunks that split meaning badly or queries that do not match the document wording lead to weak matches. Monitor speed, text colour, and user volume do not change which passages the retriever finds.
Question 22
Why should a prompt template keep instructions, retrieved context, and the user's question in clearly separate sections?
- AIt removes the need for evaluation, because a well-structured template is assumed to produce correct answers every time
- BIt increases the amount of memory that the model is able to use while it generates the answer for the current request
- CIt sends the prompt to the model in a different font so that the request is easier for the model to recognize
- DIt makes the prompt easier to maintain and reduces the chance that text in the user's input overrides the instructions
Show answer and explanationHide answer
Correct answer: DSeparating sections makes the template maintainable and makes it harder for user text to be mistaken for instructions. Memory, font, and the claim that structure removes evaluation are not accurate.
Question 23
Which two are valid ways to improve the answer quality of a RAG system? (Choose two.)
- ARe-ranking the retrieved passages before they are given to the model so that the most relevant ones come first
- BIgnoring the retrieval step and relying on the model's memory, since the retrieved text only adds noise to the prompt
- CEvaluating the retrieval step and the generation step separately, so that the cause of a weak answer can be found
- DSetting the temperature to its maximum for every answer, so that the model explores the widest possible range of text
- ERemoving all source citations from the answers, so that the users focus on the content rather than where it came from
Show answer and explanationHide answer
Correct answer: A, CRe-ranking puts the most relevant passages first, and evaluating retrieval and generation separately reveals which part is failing. Relying on memory, maximum temperature, and removing citations each weaken grounding or reliability.
Deploying and Governing Generative AI Applications (7 questions)
Question 24
Which practice supports monitoring a deployed generative AI application?
- AChecking only that the server's power light is on, since the other aspects of the service are assumed to be working
- BTracking response quality, latency, cost, and user feedback over time, with alerts when they move outside agreed limits
- CPrinting the application logs once a month and filing them in a cabinet for a review that is held once a year
- DTurning off the application logs so that the storage cost stays low and the monitoring team has less data to read
Show answer and explanationHide answer
Correct answer: BOngoing tracking of quality, latency, cost, and feedback, with alerts, shows whether the application is performing as intended in production. A power light, monthly paper logs, and disabled logs each leave problems undetected.
Question 25
What is the purpose of a guardrail in a generative AI application?
- AReducing the brightness of the screen so that users can read the answers more comfortably during long sessions
- BSpeeding up the hardware that runs the model so that responses return more quickly to the users of the service
- CFiltering or blocking content that violates policy, such as harmful or out-of-scope outputs, before it is shown
- DStoring the passwords of the users in an encrypted vault so that they can be recovered after a lost device
Show answer and explanationHide answer
Correct answer: CGuardrails check inputs and outputs against policy and block or rewrite content that is harmful or out of scope. Screen brightness, hardware speed, and password vaults do not control what the model says.
Question 26
Which deployment pattern lets a team test a new model version with a small share of users before a full rollout?
- AA big-bang replacement, in which every user is moved to the new version at the same moment the change is deployed
- BA canary or staged rollout, which exposes a small share of traffic to the new version and expands it if results hold
- CDeploying the new version only on a single engineer's laptop, where it can be tested in isolation from the users
- DDeleting the old version before the new version is deployed, so that only one version is ever available to users
Show answer and explanationHide answer
Correct answer: BA canary or staged rollout exposes a fraction of traffic to the new version and widens it only when results are acceptable. Big-bang replacement, deleting the old version, and laptop-only testing each remove the controlled exposure.
Question 27
What does governance for a generative AI program typically cover?
- APolicies for data use, approval of models for use, risk review, and records that support audit of the system
- BThe arrangement of office furniture on each floor of the building where the team is located during the project
- CThe colour palette that the marketing department uses for the posters that promote the application to employees
- DThe holiday calendar that the team uses to plan the leave of its members across the whole project period each year
Show answer and explanationHide answer
Correct answer: AGovernance sets the rules for data use, model approval, risk review, and audit records that keep generative AI use accountable. Furniture, poster colours, and holiday planning are not governance concerns.
Question 28
Why should a team keep an audit trail of prompts, model versions, and outputs for a production application?
- ATo remove the need for monitoring, because a complete audit trail shows every problem as soon as it happens
- BTo make the model run faster, since the audit trail allows the platform to cache the most common responses
- CTo reduce the amount of storage used for images, because the audit trail replaces the image files of the application
- DTo investigate incidents and to show how a given output was produced by a particular version of the system
Show answer and explanationHide answer
Correct answer: DAn audit trail links an output to the prompt and model version that produced it, which is essential for investigating incidents and for accountability. It does not speed the model, reduce image storage, or replace monitoring.
Question 29
What is an appropriate response when monitoring shows a sudden rise in harmful outputs from a deployed model?
- APausing or rolling back the affected version, investigating the cause, and strengthening the guardrails before resuming
- BIgnoring the alerts because the rise may be temporary, and waiting to see whether the problem fixes itself over time
- CDeleting the logs of the affected period so that the incident does not appear in the reports to management or regulators
- DRaising the temperature of the model so that the outputs become more varied and the harmful pattern is diluted quickly
Show answer and explanationHide answer
Correct answer: APausing or rolling back limits further harm, while investigation and stronger guardrails address the cause before the service resumes. Ignoring alerts, deleting logs, and raising temperature each increase harm or hide the incident.
Question 30
Which two controls help protect a deployed generative AI application? (Choose two.)
- AAccess controls on the application endpoint and on the data sources that the application is allowed to use
- BPublishing the API key on a public web page, so that every developer who needs it can find it without asking
- CLogging every request with an identifier so that each action can be traced back to its source for an audit later
- DDisabling authentication on the endpoint so that the requests from the mobile application do not need a sign-in
- ESharing one administrator password among the whole team, so that changes can be made quickly by any member
Show answer and explanationHide answer
Correct answer: A, CAccess controls limit who can call the application and which data it can reach, and request logging with identifiers supports traceability. Public keys, disabled authentication, and shared administrator passwords each remove a control that protects the service.