1127-25 Language Practice Questions

In the context of generating text with a Large Language Model (LLM), what does the process of greedy decoding entail?

• AA. Selecting a random word from the entire vocabulary at each step
• BB. Picking a word based on its position in a sentence structure
• CC. Choosing the word with the highest probability at each step of decoding
• DD. Using a weighted random selection based on a modulated distribution

How do Dot Product and Cosine Distance differ in their application to comparing text embeddings in natural language processing?

• AA. Dot Product assesses the overall similarity in content, whereas Cosine Distance measures topical relevance.
• BB. Dot Product is used for semantic analysis, whereas Cosine Distance is used for syntactic comparisons.
• CC. Dot Product measures the magnitude and direction of vectors, whereas Cosine Distance focuses on the orientation regardless of magnitude.
• DD. Dot Product calculates the literal overlap of words, whereas Cosine Distance evaluates the stylistic similarity.