debugging

Signed-off-by: Sage Moore <sage@neuralmagic.com>
2025-06-03 19:25:01 +00:00
parent e080e068ed
commit 2e3484c237
4 changed files with 21 additions and 21 deletions
--- a/examples/offline_inference/data_parallel.py
+++ b/examples/offline_inference/data_parallel.py
@ -83,7 +83,7 @@ def main(args, dp_size, local_dp_rank, global_dp_rank, dp_master_ip,
        "The president of the United States is",
        "The capital of France is",
        "The future of AI is",
-    ]
+    ] * 100

    # with DP, each rank should process different prompts.
    # usually all the DP ranks process a full dataset,