Tuning Large Language Model with VertexAIPermalink

Why Model Tuning?Permalink

Tuning is required when you want the model to learn something niche or specific that deviates from general language patterns.

Goal of TuningPermalink

ClassificationPermalink

prompt: “Classify the following text into one of the following classes: [business, entertainment].”

SummarizationPermalink

prompt: “Summarize: Jessica: That sounds great! See you in Times Square! Alexander: See you at 10!”

response: “#Person1 and #Person2 agree to meet at Times Square at 10:00 AM.”

Extract QAPermalink

prompt: “Context: There is evidence that there have been significant changes in Amazon rainforest vegetation over the last 21,000 years through the Last Glacial Maximum (LGM) and subsequent deglaciation. Question: What does LGM stand for?”

response: “Last Glacial Maximum”

Prepare your model tuning datasetPermalink

Recommended configurationsPermalink

The following table shows the recommended configurations for tuning a foundation model by task:

For train steps, you can try more than one value to get the best performance on a particular dataset, for example, 100, 200, 500.

Dataset formatPermalink

You can create your own dataset for training. Your dataset must be in JSON Lines (JSONL) format where each line contains a single training example. Content of JSONL file will be like below.

{“input_text”: “question: How many copies of Gears of War 3 were sold ? context: Like its predecessors , the game received widespread critical acclaim from critics . Critics praised its story , voice acting , graphics and visuals , and music , but criticized its lack of innovation . Gears of War 3 sold over 3 million copies and was the second best selling game in the U . S . “, “output_text”: “over 3 million copies”} {“input_text”: “question: How many parishes are there in Louisiana ? context: The U . S . state of Louisiana is divided into 64 parishes ( French : paroisses ) in the same manner that 48 other states of the United States are divided into counties , and Alaska is divided into boroughs . “, “output_text”: “64”}

Creating DatasetPermalink

Prepare model tuning dataset (train dataset) Maintain consistency with test and production data (same format).

For example, if the examples in your dataset includes a “question:” and a “context:”, production traffic should also be formatted to include a “question:” and a “context:” in the same order as it appears in the dataset examples. If you exclude the context, the model will be confused as to what you are asking, even if the exact question was in an example in the dataset.

Include instructions in examples.
Classify the following text into one of the following classes: [business, entertainment] Text: 5 stocks to buy now

Upload tuning dataset to Cloud Storage (Optional)Permalink

For the demo use following example. Otherwise bring your dataset in the format below. cloud-samples-data/ai-platform/generative_ai/headline_classification.jsonl

Tuning with VertexAIPermalink

• VertexAI -> Language -> Create Tune Model
• Select the tuning dataset (either from google cloud storage or cloud-samples-data/ai-platform/generative_ai/headline_classification.jsonl)
  • The above dataset contains 25 categorical question answering examples. If you use the sample dataset, the training will take 1-2 hours.
• Configure the model details & Tune
  • Model name: Enter a name for your tuned model.
  • Base model: Select the foundation model that you want to tune.
  • Train steps: Enter the number of steps to run for model tuning. 1000 steps will take 2-3 hours to complete tuning.
  • Learning rate: Control the step size at which a model updates its weights during training. Default: 3.
  • Working directory: Enter the URI of the bucket to store the tuned model. If don’t have one, you can create a new bucket.

After tuningPermalink

• To check the status of your model tuning job, go to the Pipelines page. The status of your pipeline can be found in the Runs section.
• To view your tuned models in the Google Cloud console, go to the Vertex AI Model Registry page.

Use the tuned modelPermalink

• To use your tuned models with new prompts, go to the Language page.
• Click Text prompt.
• In the Model drop down, select the tuned model that you have created.
• Copy the sample prompt and submit to view the results.

Multi-choice problem: What is the topic of this text?
- business
- entertainment
- health
- sports
- technology
- politics
Text: What is a large language model (LLM)?
The answer is: