onnx的模型加载,需要用到onnx runtime。 推理代码: Python复制 123456789101112131415161718192021222324252627282930313233 import torch import onnxruntime as rt from transformers import LlamaTokenizer def generate_prompt(text): return f"""Below is an instruction that describes a ta…

