Repository navigation
[Feature Request] Add sample demonstrating how to make liteLLM calls from a workflow #239
Description
Activity
- changed the title
[-][Feature Request] Add sample demonstrating how to make LLM calls from a workflow[/-][+][Feature Request] Add sample demonstrating how to make liteLLM calls from a workflow[/+]on Sep 9, 2025 The AI Cookbook will contain this sample soon (and others). We could still put a version here, but it might not be necessary.
Hi @dandavison and @jssmith — before I start, could you confirm whether a samples-python version is still wanted now that the AI Cookbook may cover this?
I have hands-on experience combining Temporal, Python, and production LLM workflows. If the sample is still useful, I propose keeping it focused:
- Call LiteLLM only from Temporal Activities, not Workflow code.
- Demonstrate timeouts, retries, and workflow-safe inputs/results.
- Add deterministic tests using mocked provider calls, with no live API dependency.
- Include a README explaining why network I/O must remain outside Workflow code.
If this scope is aligned with what you want, could you assign the issue to me?
Reacted by Brian StrauchHi @Abhinav0905, feel free to open a PR. Tag me and I'll take a look when it's ready.
- HI there, Please find the PR -- #343 Regards…On Wed, Jul 29, 2026 at 4:16 PM Brian Strauch ***@***.***> wrote: *brianstrauch* left a comment (temporalio/samples-python#239) <#239 (comment)> Hi @Abhinav0905 <https://github.com/Abhinav0905>, feel free to open a PR. Tag me and I'll take a look when it's ready. — Reply to this email directly, view it on GitHub <#239?email_source=notifications&email_token=A745GZOOYJMGMBDXPX5ZE2L5HKAUPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTKMJSGQZTIOJXGI32M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-5124349727>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A745GZPAW7CJH23MIJOXV6T5HKAUPAVCNFSNUABFKJSXA33TNF2G64TZHM2DKNBVGU3TQOBUHNEXG43VMU5TGMZVGY2DONBTGQ42C5QC> . Triage notifications, keep track of coding agent tasks and review pull requests on the go with GitHub Mobile for iOS <https://github.com/notifications/mobile/ios/A745GZJFCLW4DQ7XLGHWMO35HKAUPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTKMJSGQZTIOJXGI32M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJKTGN5XXIZLSL5UW64Y> and Android <https://github.com/notifications/mobile/android/A745GZI5VJHEDPPOR7PLC7D5HKAUPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTKMJSGQZTIOJXGI32M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLTGN5XXIZLSL5QW4ZDSN5UWI>. Download it today! You are receiving this because you were mentioned.Message ID: ***@***.***>Reacted by Brian Strauch
Add a sample demonstrating how to make LLM calls from a workflow via an activity.
This should use https://github.com/BerriAI/litellm.
(It may make sense to add something like this to SDK
contrib/eventually.)