# "The function 'tokenize\_tweets' is not available in the 'tokenizers' package" error in Text Analysis

**URL:** <https://community.exploratory.io/t/the-function-tokenize-tweets-is-not-available-in-the-tokenizers-package-error-in-text-analysis/4306>\
**Category:** Issues\
**Created:** [November 19, 2026, 12:42am UTC](https://community.exploratory.io/t/the-function-tokenize-tweets-is-not-available-in-the-tokenizers-package-error-in-text-analysis/4306 "2026-11-19T00:42:36Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Takato\_Shiroto](https://community.exploratory.io/user_avatar/community.exploratory.io/takato_shiroto/32/749_2.png) [@Takato\_Shiroto](https://community.exploratory.io/u/Takato_Shiroto)\
**Post date:** [November 19, 2026, 12:42am UTC](https://community.exploratory.io/t/the-function-tokenize-tweets-is-not-available-in-the-tokenizers-package-error-in-text-analysis/4306/1 "2026-11-19T00:42:36Z")

</div>

When you run a text analysis (such as Word Count), you may see the following error.

The function ‘tokenize\_tweets’ is not available in the ‘tokenizers’ package.

 ![tokenize_tweets_en](https://community.exploratory.io/uploads/default/original/2X/d/d413e33ac0079da98867baea0bc430c1fef4137d.png)

### Cause

This error occurs when “Clean Up Twitter Data (# and @)” is set to “Yes” in the Properties while Compound Words (a Compound Word Dictionary or Additional Compound Words) are specified.

### Solution

Set “Clean Up Twitter Data (# and @)” to “No” in the Properties and click “Apply”.

If the solution above does not resolve the issue, please contact our support team ([support@exploratory.io](mailto:support@exploratory.io)).
