Skip to content

Redis upgrades - #538

Merged
duckduckgrayduck merged 3 commits into
masterfrom
lambda-redis-upgrade
Nov 9, 2026
Merged

duckduckgrayduck merged 3 commits into
masterfrom
lambda-redis-upgrade

Conversation

@duckduckgrayduck

@duckduckgrayduck duckduckgrayduck commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor
  • Updates redis in the lambda processing pipeline which allows us to remove the setuptools pin
  • Updates the local redis backend to Valkey 9 to match production & staging
  • Updates redis, django-redis and fakeredis packages

This is all on staging and appears to be working. I have:

  • Uploaded a document
  • Uploaded several documents
  • Redacted a document
  • Re-processed a document, forcing OCR (including textract)
  • Uploaded a different file type to exercise the Libreoffice conversion process

Comment thread local.yml Resolved
@mitchelljkotler

Copy link
Copy Markdown
Member

Claude claims the redis upgrades are incompatible with the version of celery we are using - has that been tested?

@duckduckgrayduck

duckduckgrayduck commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor Author

Claude claims the redis upgrades are incompatible with the version of celery we are using - has that been tested?

Running pip check locally reports no broken requirements with redis 8.1.0. We install celery without the [redis] extra.

I also checked the logs in Papertrail. After deploying this to staging, the Celery worker and beat dynos connected to the Redis broker over TLS without errors. I merged this into staging at 1:11 EST. This is from 1:15 EST on staging:
Nov 09 01:15:31 PM documentcloud-staging app/solr_worker.1 [2026-11-09 18:15:31,585: INFO/MainProcess] Connected to rediss://:
and tasks from uploads, redactions, Textract OCR and conversions completed with no failures in the worker logs or Sentry.

@duckduckgrayduck
duckduckgrayduck merged commit 98a5d38 into master Nov 9, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants