modalities.inference package

Subpackages

• modalities.inference.text package
  • Submodules
  • modalities.inference.text.config module
    • TextInferenceComponentConfig
      • TextInferenceComponentConfig.device
      • TextInferenceComponentConfig.eod_token
      • TextInferenceComponentConfig.model
      • TextInferenceComponentConfig.model_config
      • TextInferenceComponentConfig.parse_device()
      • TextInferenceComponentConfig.prompt_template
      • TextInferenceComponentConfig.sequence_length
      • TextInferenceComponentConfig.temperature
      • TextInferenceComponentConfig.tokenizer
  • modalities.inference.text.inference_component module
    • TextInferenceComponent
      • TextInferenceComponent.generate_tokens()
      • TextInferenceComponent.run()
  • Module contents

Submodules

modalities.inference.inference module

modalities.inference.inference.generate_text(config_path, registry=None)

Parameters:

• config_path (Annotated[Path, PathType(path_type=file)])

• registry (Registry | None)

Module contents