Repository navigation
Open
Labels
meetingMeeting notes.Meeting notes.
Description
Agenda
Reminder: Phase 12 moonshot workshop is happening next Tuesday.
This meeting: Phase 11 close out, towards release.
ActivitySim
Discussion requested: estimation notebooks in CI
- Stefan and Sijia asked to discuss #1136 Park-and-ride lot choice estimation (draft). It fails CI because its new notebook has no matching estimation data. The telework notebooks for #1126 hit the same problem. Sijia's questions:
- Does every new component need an example estimation notebook, even one that only calls standard Larch methods?
- If so, must the notebook run in CI?
- If so, add estimation data to the MTC example used by CI, or build a SANDAG set?
Issues
- #1137
skip_failed_choicesrecords person IDs as household IDs. Jeff found this pre-existing bug while reviewing #1130. It can drop an unrelated household. Any takers? - Sharrow #90 Slower OMX skim loading in 2.16. SANDAG reports
mp_setup_skimstakes 29.8 min with Sharrow 2.16 vs 7.4 min with 2.15. - #999
resume_afterfails onwrite_data_dictionarywith multiprocessing. Sijia was checking for a quick fix. Not urgent.
Open PRs
- #1127 Python versions. PR review done, changes requested and applied, will be merged once approved.
- #1130 Skip failed sampling choices. PR review done, changes requested and applied, will be merged once approved.
- #1125 Summarize memory reduction. Jeff to add abench results.
- #1107 Calibration. Jan reviewing. PSRC and MWCOG have tested it. Agency acceptance contact: Joe C.
- #1126 Explicit telecommute. Joe F. reviewed on 23 Oct with minor comments for Sijia. Agency reviewer and acceptance criteria still to confirm (Joe C. with Sijia). Estimation notebooks: see the CI discussion above.
- #1110 Peak-memory reduction. Jeff addressed review comments. MTC full-scale runs on Windows done, question regarding memory release on Windows but otherwise good to go.
- #1086 Application and Analysis Guide. Still a draft, Joe F. waiting for consolidated feedback?
- #1103 Faster RNG. On hold. David posted SANDAG results on 22 Oct: with full EET and no Poisson sampling, disaggregate accessibility runtime roughly halves but stays slower than legacy Monte Carlo (and therefore Poisson sampling). He argues for keeping the code for future full-EET work, such as system-wide shadow pricing. Jeff to try to reproduce with EET benchmarks. Defer to Phase 12?
- Python 3.14 PR on outerloop fork, blocked by Sharrow #89 and Larch #21. PRs open, need reviewer.
PopulationSim
- #225 Intermediate geographies. Approved by Joe F. on 22 Oct; ready to merge.
- #226 Docs, CI and release modernization. Jeff arranging AI-assisted review. Includes the certificate-related dependency updates.
- Dependabot: #227 virtualenv (replaces closed #224, relevant to the certificate fix) and #223 urllib3. Jan to check if in #225, otherwise merge.
Metadata
Metadata
Assignees
Labels
meetingMeeting notes.Meeting notes.
Activity
janzill commentedon Nov 1, 2026
Meeting Notes
Meeting Overview
Participants
Duration
50 minutes
Executive Summary
The last engineering meeting before the Phase 12 moonshot workshop, held as Phase 11 closes out towards a release. People invited to join the bench were added to the meeting series this week, and Tim Veitch and Billy Charlton attended for the first time.
Most of the meeting concerned estimation notebooks for new components. Draft #1136 (park-and-ride lot choice estimation) fails CI because the fake estimation survey data, derived from the MTC example, does not cover the component; the telework notebooks for #1126 were moved outside CI for the same reason. Sijia questioned the value of near-identical notebooks for simple MNL components. Jan and Amir favoured a notebook for every component, Amir stressing structured tests in notebooks over bare estimation calls. David noted that every component added for SANDAG lacks estimation coverage. Coverage, and whether to build SANDAG-based test data, was tabled for Phase 12; no decision was made on how #1136 should pass CI in the meantime.
Elsewhere: the faster-RNG pull request was deferred to Phase 12 and will not be merged now; PopulationSim intermediate geographies was agreed for merge, with the release-tooling update to land before the end-of-phase PopulationSim release; the Sharrow 2.16 skim-loading slowdown may be addressed by the new h5py-based OpenMatrix release rather than by duplicating code in Sharrow; and Amir's memo on alpha and beta releases and structured testing is to go on the next agenda. RSG believes the PopulationSim weight-cap issue may be a misunderstanding of the setting and will post its findings.
Meeting Notes
Meeting Format and New Participants
Phase 12 Moonshot Workshop
Estimation Notebooks in CI
Slower OMX Skim Loading in Sharrow 2.16
Python Version Support
Remaining ActivitySim Issues and Pull Requests
resume_afterfails onwrite_data_dictionarywith multiprocessing): Sijia has not yet looked at it and will do so when time allows. It is not urgent and can be backlogged.summarizestep, which runs non-parallel. It has no performance testing yet; Jeff is to add abench results in the coming days.Peak-Memory Reduction
Faster RNG Deferred to Phase 12
PopulationSim Release Work
Release and Testing Practice
PopulationSim Household Weight Cap
Action Items