Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

NVIDIA NIM Connector Guide

NVIDIA NIM Connector Guide

Using an NVIDIA NIM connection in a process

Using an NVIDIA NIM connection in a process

After you create an NVIDIA NIM connection, you can use it in a Service step in a process.
  1. Add a Service step to the process.
  2. Click the
    Service
    tab.
  3. From the
    Service Type
    list, select
    Connection
    .
  4. From the
    Connection
    list, browse and select the NVIDIA NIM connection that you created.
  5. From the
    Action
    list, select the action that you want to perform. For example, select the
    Invoke Basic Model
    action to invoke the basic models for chat completions, function calling, text reranking, and structured output actions as shown in the following image:
    The image shows the Invoke Basic Model action that is used in a process
							to invoke the basic models for chat completions, function calling, text
							reranking, and structured output actions.
    In this case, Application Integration populates the
    host
    ,
    version
    ,
    segment1
    , …,
    segment5
    , and
    payload
    objects under the input fields and the
    response
    and
    statusCode
    objects under the output fields.
  6. Configure further steps as needed.
  7. Validate, save, and publish the process.

0 COMMENTS

We’d like to hear from you!