This project contains known security vulnerabilities. Find detailed information at the bottom.

Crate tiktoken-rs

Dependencies

(10 total, 5 outdated, 1 insecure)

CrateRequiredLatestStatus
 anyhow^1.0.761.0.104up to date
 async-openai^0.14.20.42.0out of date
 base64^0.21.50.23.1out of date
 bstr^1.6.21.13.1up to date
 dhat^0.3.20.3.3up to date
 fancy-regex^0.12.00.19.2out of date
 lazy_static^1.4.01.5.0up to date
 parking_lot^0.12.10.12.5up to date
 pyo3 ⚠️^0.19.20.29.2insecure
 rustc-hash^1.1.02.1.3out of date

Security Vulnerabilities

pyo3: Risk of buffer overflow in `PyString::from_object`

RUSTSEC-2025-0020

PyString::from_object took &str arguments and forwarded them directly to the Python C API without checking for terminating nul bytes. This could lead the Python interpreter to read beyond the end of the &str data and potentially leak contents of the out-of-bounds read (by raising a Python exception containing a copy of the data including the overflow).

In PyO3 0.24.1 this function will now allocate a CString to guarantee a terminating nul bytes. PyO3 0.25 will likely offer an alternative API which takes &CStr arguments.

pyo3: Missing `Sync` bound on `PyCFunction::new_closure` closures

RUSTSEC-2026-0177

PyCFunction::new_closure (and the temporary new_closure_bound complement in the 0.21–0.22 series) required the supplied closure to be Send + 'static but not Sync. The resulting PyCFunction is a Python callable that can be invoked from any Python thread, which means the closure may be called concurrently from multiple threads, and needs a Sync bound to prevent possible data races.

The problem exists under all Python versions but is particularly vulnerable under the newer free-threaded Python variant, which do not have serial execution imposed by the Global Interpreter Lock. Under releases protected by the GIL, the ability to "detach" from the Python interpreter temporarily inside the closure (e.g. by Python::detach) makes it possible for interleaved and/or concurrent execution of various portions of the closure.

PyO3 0.29.0 added a Sync bound to close this thread-safety bug.