[ISSUE]error testing 'ollama-instance-1'. Error from LLM provider 'ollama_chatEception - [errno111] connection refused

[daizappdev]

error testing 'ollama-instance-1'. Error from LLM provider 'ollama_chatEception - [errno111] connection refused

I am unable to configure Ollama at localhost:11434.

When I run the curl command or try opening http://localhost:11434/ in the browser, it confirms that Ollama is running.
Despite this, the SDK does not seem to recognize it.
Could you please advise if I might be missing any configuration steps?

[sivabala21]

Is this bug fixed? which version will work

[safegeq]

Same error with complete new installation. tested with latest, v0.144.0 and v0.140

unstract-backend | 172.18.0.12 - - [08/Jan/2026:10:05:42 +0000] "GET /api/v1/socket/?EIO=4&transport=websocket HTTP/1.1" 400 27 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/142.0.0.0 Safari/537.36"
unstract-celery-beat | INFO : [2026-01-08 10:05:44,296]{module:base process:1 thread:125723874995072 request_id:- trace_id:- span_id:-} :- DB connection (ID: 125722619704512) is established or reused.
unstract-backend | [2026-01-08 10:05:48 +0000] [31] [DEBUG] POST /api/v1/unstract/mock_org/test_adapters/
unstract-backend | INFO : [2026-01-08 10:05:48,992]{module:base process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :- DB connection (ID: 131397664123584) is established or reused.
unstract-backend | 10:05:49 - LiteLLM:INFO: utils.py:3422 -
unstract-backend | LiteLLM completion() model= gpt-oss:120b; provider = ollama_chat
unstract-backend | INFO : [2026-01-08 10:05:49,028]{module:utils process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :-
unstract-backend | LiteLLM completion() model= gpt-oss:120b; provider = ollama_chat
unstract-backend |
unstract-backend | Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
unstract-backend | LiteLLM.Info: If you need to debug this error, use `litellm._turn_on_debug()'.
unstract-backend |
unstract-backend | ERROR : [2026-01-08 10:05:49,085]{module:llm process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :- [sdk1][LLM] Error during completion: litellm.APIConnectionError: Ollama_chatException - [Errno 111] Connection refused
unstract-backend | INFO : [2026-01-08 10:05:49,085]{module:exceptions process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :- Stripping litellm prefix from error: litellm.APIConnectionError: Ollama_chatException - [Errno 111] Connection refused
unstract-backend | Error testing 'gptoss'. Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused: /api/v1/unstract/mock_org/test_adapters/
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 101, in map_httpcore_exceptions
unstract-backend | yield
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 250, in handle_request
unstract-backend | resp = self._pool.handle_request(req)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request
unstract-backend | raise exc from None
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request
unstract-backend | response = connection.handle_request(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 101, in handle_request
unstract-backend | raise exc
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 78, in handle_request
unstract-backend | stream = self._connect(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 124, in _connect
unstract-backend | stream = self._network_backend.connect_tcp(**kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_backends/sync.py", line 207, in connect_tcp
unstract-backend | with map_exceptions(exc_map):
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
unstract-backend | self.gen.throw(value)
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
unstract-backend | raise to_exc(exc) from exc
unstract-backend | httpcore.ConnectError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 196, in _make_common_sync_call
unstract-backend | response = sync_httpx_client.post(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 900, in post
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 879, in post
unstract-backend | response = self.client.send(req, stream=stream)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 914, in send
unstract-backend | response = self._send_handling_auth(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 942, in _send_handling_auth
unstract-backend | response = self._send_handling_redirects(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 979, in _send_handling_redirects
unstract-backend | response = self._send_single_request(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1014, in _send_single_request
unstract-backend | response = transport.handle_request(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 249, in handle_request
unstract-backend | with map_httpcore_exceptions():
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
unstract-backend | self.gen.throw(value)
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions
unstract-backend | raise mapped_exc(message) from exc
unstract-backend | httpx.ConnectError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | During handling of the above exception, another exception occurred:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3406, in completion
unstract-backend | response = base_llm_http_handler.completion(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 499, in completion
unstract-backend | response = self._make_common_sync_call(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 223, in _make_common_sync_call
unstract-backend | raise self._handle_error(e=e, provider_config=provider_config)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 3569, in _handle_error
unstract-backend | raise provider_config.get_error_class(
unstract-backend | litellm.llms.ollama.common_utils.OllamaError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | During handling of the above exception, another exception occurred:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 214, in complete
unstract-backend | response: dict[str, object] = litellm.completion(
unstract-backend | ^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1377, in wrapper
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1246, in wrapper
unstract-backend | result = original_function(*args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3770, in completion
unstract-backend | raise exception_type(
unstract-backend | ^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2323, in exception_type
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2292, in exception_type
unstract-backend | raise APIConnectionError(
unstract-backend | litellm.exceptions.APIConnectionError: litellm.APIConnectionError: Ollama_chatException - [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 123, in test_adapter
unstract-backend | return llm.test_connection()
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 143, in test_connection
unstract-backend | response = self.complete("What is the capital of Tamilnadu?")
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/utils/common.py", line 214, in wrapper
unstract-backend | result = func(self, *args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 268, in complete
unstract-backend | raise LLMError(
unstract-backend | unstract.sdk1.exceptions.LLMError: Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/rest_framework/views.py", line 506, in dispatch
unstract-backend | response = handler(request, *args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/adapter_processor_v2/views.py", line 129, in test
unstract-backend | test_result = AdapterProcessor.test_adapter(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 143, in test_adapter
unstract-backend | raise TestAdapterError(
unstract-backend | adapter_processor_v2.exceptions.TestAdapterError: Error testing 'gptoss'. Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused
unstract-backend | ERROR : [2026-01-08 10:05:49,087]{module:log process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :- Error testing 'gptoss'. Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused: /api/v1/unstract/mock_org/test_adapters/
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 101, in map_httpcore_exceptions
unstract-backend | yield
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 250, in handle_request
unstract-backend | resp = self._pool.handle_request(req)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request
unstract-backend | raise exc from None
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request
unstract-backend | response = connection.handle_request(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 101, in handle_request
unstract-backend | raise exc
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 78, in handle_request
unstract-backend | stream = self._connect(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 124, in _connect
unstract-backend | stream = self._network_backend.connect_tcp(**kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_backends/sync.py", line 207, in connect_tcp
unstract-backend | with map_exceptions(exc_map):
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
unstract-backend | self.gen.throw(value)
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
unstract-backend | raise to_exc(exc) from exc
unstract-backend | httpcore.ConnectError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 196, in _make_common_sync_call
unstract-backend | response = sync_httpx_client.post(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 900, in post
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 879, in post
unstract-backend | response = self.client.send(req, stream=stream)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 914, in send
unstract-backend | response = self._send_handling_auth(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 942, in _send_handling_auth
unstract-backend | response = self._send_handling_redirects(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 979, in _send_handling_redirects
unstract-backend | response = self._send_single_request(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1014, in _send_single_request
unstract-backend | response = transport.handle_request(request)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 249, in handle_request
unstract-backend | with map_httpcore_exceptions():
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
unstract-backend | self.gen.throw(value)
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions
unstract-backend | raise mapped_exc(message) from exc
unstract-backend | httpx.ConnectError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | During handling of the above exception, another exception occurred:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3406, in completion
unstract-backend | response = base_llm_http_handler.completion(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 499, in completion
unstract-backend | response = self._make_common_sync_call(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 223, in _make_common_sync_call
unstract-backend | raise self._handle_error(e=e, provider_config=provider_config)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 3569, in _handle_error
unstract-backend | raise provider_config.get_error_class(
unstract-backend | litellm.llms.ollama.common_utils.OllamaError: [Errno 111] Connection refused
unstract-backend |
unstract-backend | During handling of the above exception, another exception occurred:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 214, in complete
unstract-backend | response: dict[str, object] = litellm.completion(
unstract-backend | ^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1377, in wrapper
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1246, in wrapper
unstract-backend | result = original_function(*args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3770, in completion
unstract-backend | raise exception_type(
unstract-backend | ^^^^^^^^^^^^^^^
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2323, in exception_type
unstract-backend | raise e
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2292, in exception_type
unstract-backend | raise APIConnectionError(
unstract-backend | litellm.exceptions.APIConnectionError: litellm.APIConnectionError: Ollama_chatException - [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 123, in test_adapter
unstract-backend | return llm.test_connection()
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 143, in test_connection
unstract-backend | response = self.complete("What is the capital of Tamilnadu?")
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/utils/common.py", line 214, in wrapper
unstract-backend | result = func(self, *args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 268, in complete
unstract-backend | raise LLMError(
unstract-backend | unstract.sdk1.exceptions.LLMError: Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused
unstract-backend |
unstract-backend | The above exception was the direct cause of the following exception:
unstract-backend |
unstract-backend | Traceback (most recent call last):
unstract-backend | File "/app/.venv/lib/python3.12/site-packages/rest_framework/views.py", line 506, in dispatch
unstract-backend | response = handler(request, *args, **kwargs)
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/adapter_processor_v2/views.py", line 129, in test
unstract-backend | test_result = AdapterProcessor.test_adapter(
unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 143, in test_adapter
unstract-backend | raise TestAdapterError(
unstract-backend | adapter_processor_v2.exceptions.TestAdapterError: Error testing 'gptoss'. Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused
unstract-backend | ERROR : [2026-01-08 10:05:49,111]{module:exception process:31 thread:131397648414400 request_id:238c3bd2-7e52-4199-b732-06610537ee9b trace_id:- span_id:-} :- POST http://frontend.luecker.com/api/v1/unstract/mock_org/test_adapters/ 500
unstract-backend |
unstract-backend | TestAdapterError(LLMError("Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused"))
unstract-backend |
unstract-backend | Traceback (most recent call last): unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 101, in map_httpcore_exceptions unstract-backend | yield unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 250, in handle_request unstract-backend | resp = self._pool.handle_request(req) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request unstract-backend | raise exc from None unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request unstract-backend | response = connection.handle_request( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 101, in handle_request unstract-backend | raise exc unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 78, in handle_request unstract-backend | stream = self._connect(request) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 124, in _connect unstract-backend | stream = self._network_backend.connect_tcp(**kwargs) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_backends/sync.py", line 207, in connect_tcp unstract-backend | with map_exceptions(exc_map): unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ unstract-backend | self.gen.throw(value) unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions unstract-backend | raise to_exc(exc) from exc unstract-backend | httpcore.ConnectError: [Errno 111] Connection refused unstract-backend | unstract-backend | The above exception was the direct cause of the following exception: unstract-backend | unstract-backend | Traceback (most recent call last): unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 196, in _make_common_sync_call unstract-backend | response = sync_httpx_client.post( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 900, in post unstract-backend | raise e unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/http_handler.py", line 879, in post unstract-backend | response = self.client.send(req, stream=stream) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 914, in send unstract-backend | response = self._send_handling_auth( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 942, in _send_handling_auth unstract-backend | response = self._send_handling_redirects( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 979, in _send_handling_redirects unstract-backend | response = self._send_single_request(request) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1014, in _send_single_request unstract-backend | response = transport.handle_request(request) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 249, in handle_request unstract-backend | with map_httpcore_exceptions(): unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ unstract-backend | self.gen.throw(value) unstract-backend | File "/app/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions unstract-backend | raise mapped_exc(message) from exc unstract-backend | httpx.ConnectError: [Errno 111] Connection refused unstract-backend | unstract-backend | During handling of the above exception, another exception occurred: unstract-backend | unstract-backend | Traceback (most recent call last): unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3406, in completion unstract-backend | response = base_llm_http_handler.completion( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 499, in completion unstract-backend | response = self._make_common_sync_call( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 223, in _make_common_sync_call unstract-backend | raise self._handle_error(e=e, provider_config=provider_config) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 3569, in _handle_error unstract-backend | raise provider_config.get_error_class( unstract-backend | litellm.llms.ollama.common_utils.OllamaError: [Errno 111] Connection refused unstract-backend | unstract-backend | During handling of the above exception, another exception occurred: unstract-backend | unstract-backend | Traceback (most recent call last): unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 214, in complete unstract-backend | response: dict[str, object] = litellm.completion( unstract-backend | ^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1377, in wrapper unstract-backend | raise e unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/utils.py", line 1246, in wrapper unstract-backend | result = original_function(*args, **kwargs) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/main.py", line 3770, in completion unstract-backend | raise exception_type( unstract-backend | ^^^^^^^^^^^^^^^ unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2323, in exception_type unstract-backend | raise e unstract-backend | File "/app/.venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2292, in exception_type unstract-backend | raise APIConnectionError( unstract-backend | litellm.exceptions.APIConnectionError: litellm.APIConnectionError: Ollama_chatException - [Errno 111] Connection refused unstract-backend | unstract-backend | The above exception was the direct cause of the following exception: unstract-backend | unstract-backend | Traceback (most recent call last): unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 123, in test_adapter unstract-backend | return llm.test_connection() unstract-backend | ^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 143, in test_connection unstract-backend | response = self.complete("What is the capital of Tamilnadu?") unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/utils/common.py", line 214, in wrapper unstract-backend | result = func(self, *args, **kwargs) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/unstract/sdk1/src/unstract/sdk1/llm.py", line 268, in complete unstract-backend | raise LLMError( unstract-backend | unstract.sdk1.exceptions.LLMError: Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused unstract-backend | unstract-backend | The above exception was the direct cause of the following exception: unstract-backend | unstract-backend | Traceback (most recent call last): unstract-backend | File "/app/.venv/lib/python3.12/site-packages/rest_framework/views.py", line 506, in dispatch unstract-backend | response = handler(request, *args, **kwargs) unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/adapter_processor_v2/views.py", line 129, in test unstract-backend | test_result = AdapterProcessor.test_adapter( unstract-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ unstract-backend | File "/app/adapter_processor_v2/adapter_processor.py", line 143, in test_adapter unstract-backend | raise TestAdapterError( unstract-backend | adapter_processor_v2.exceptions.TestAdapterError: Error testing 'gptoss'. Error from LLM provider 'ollama': Ollama_chatException - [Errno 111] Connection refused unstract-backend |
unstract-backend | 172.18.0.12 - - [08/Jan/2026:10:05:49 +0000] "POST /api/v1/unstract/mock_org/test_adapters/ HTTP/1.1" 500 186 "https://frontend.luecker.com/mock_org/onboard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/142.0.0.0 Safari/537.36"

[safegeq]

the network connection from the backend container is normal an the ollama endpoint kann be reached successfully

docker exec -i unstract-backend python3 - << 'EOF'
import http.client
try:
conn = http.client.HTTPConnection("192.168.20.25", 11434, timeout=3)
conn.request("GET", "/api/tags")
r = conn.getresponse()
print("HTTP OK:", r.status, r.reason)
print(r.read().decode())
except Exception as e:
print("HTTP FAIL:", e)
EOF
HTTP OK: 200 OK
{"models":[{"name":"gpt-oss:120b","model":"gpt-oss:120b","modified_at":"2025-11-12T14:12:28.21439156+01:00","size":65369818941,"digest":"a951a23b46a1f6093dafee2ea481d634b4e31ac720a8a16f3f91e04f5a40ecd9","details":{"parent_model":"","format":"gguf","family":"gptoss","families":["gptoss"],"parameter_size":"116.8B","quantization_level":"MXFP4"}},{"name":"mistral-small3.2:24b","model":"mistral-small3.2:24b","modified_at":"2025-11-12T12:38:59.128090579+01:00","size":15177384862,"digest":"5a408ab55df5c1b5cf46533c368813b30bf9e4d8fc39263bf2a3338cfa3b895b","details":{"parent_model":"","format":"gguf","family":"mistral3","families":["mistral3"],"parameter_size":"24.0B","quantization_level":"Q4_K_M"}},{"name":"gemma3:27b","model":"gemma3:27b","modified_at":"2025-11-12T12:17:05.33874584+01:00","size":17396936941,"digest":"a418f5838eaf7fe2cfe0a3046c8384b68ba43a4435542c942f9db00a5f342203","details":{"parent_model":"","format":"gguf","family":"gemma3","families":["gemma3"],"parameter_size":"27.4B","quantization_level":"Q4_K_M"}},{"name":"embeddinggemma:latest","model":"embeddinggemma:latest","modified_at":"2025-11-12T11:49:34.194925793+01:00","size":621875917,"digest":"85462619ee721b466c5927d109d4cb765861907d5417b9109caebc4e614679f1","details":{"parent_model":"","format":"gguf","family":"gemma3","families":["gemma3"],"parameter_size":"307.58M","quantization_level":"BF16"}},{"name":"qwen3-embedding:4b","model":"qwen3-embedding:4b","modified_at":"2025-11-12T11:35:49.879882585+01:00","size":2496704041,"digest":"df5bd2e3c74cd8d069d21dc038f1b359fcdc9458fce1c99bd43c9eb1518ff907","details":{"parent_model":"","format":"gguf","family":"qwen3","families":["qwen3"],"parameter_size":"4.0B","quantization_level":"Q4_K_M"}},{"name":"qwen3-embedding:8b","model":"qwen3-embedding:8b","modified_at":"2025-11-12T11:31:46.601942191+01:00","size":4676805193,"digest":"64b933495768fbd3b87c20583d379728a07471e0c66733a9df87cd1901b3c44b","details":{"parent_model":"","format":"gguf","family":"qwen3","families":["qwen3"],"parameter_size":"7.6B","quantization_level":"Q4_K_M"}},{"name":"qwen3:30b","model":"qwen3:30b","modified_at":"2025-11-12T11:19:13.938442866+01:00","size":18556699314,"digest":"ad815644918f0eaab341c12b67837cc6dd4562342cdaf118f83d5d554cb37226","details":{"parent_model":"","format":"gguf","family":"qwen3moe","families":["qwen3moe"],"parameter_size":"30.5B","quantization_level":"Q4_K_M"}}]}

the error doesnt change, when https is used