* initial create vocabulary utility

* extract vocabulary from embeddings

* renamed to --output-word-count-file

* added main call

* extracted iter_tokenized_tokens

* avoid empty tokens

* using tokenizer from delft

* optionally sort by count

* added file list support

* added support for remote files

* added limit argument

* added fsspec dependency

* optionally use multi threading or processing

* included full github link

* renamed to create_vocabulary

* moved to tools vocabulary

* filter embeddings

* renamed to embeddings

* using fsspec to open embeddings file when extracting

* use fsspec when filtering embeddings

* document tools

* added link to tools.md

* Bump apache-beam[gcp] from 2.28.0 to 2.29.0

Bumps [apache-beam[gcp]](https://github.com/apache/beam) from 2.28.0 to 2.29.0.
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/beam/compare/v2.28.0...v2.29.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* replaced mock with unittest.mock

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

Bumps [numpy](https://github.com/numpy/numpy) from 1.19.5 to 1.20.3.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt)
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.20.3

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

* removed usage of six

* removed six dependency

This reverts commit 612a2c3f.

* Bump pylint from 2.4.4 to 2.8.2

Bumps [pylint](https://github.com/PyCQA/pylint) from 2.4.4 to 2.8.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/master/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/pylint-2.4.4...v2.8.2

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* ignore lxml elemebt builder not callable

* addressed most linting issues

* ignore false positive unsubscriptable-object

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

* Bump flake8 from 3.7.9 to 3.9.2

Bumps [flake8](https://gitlab.com/pycqa/flake8) from 3.7.9 to 3.9.2.
- [Release notes](https://gitlab.com/pycqa/flake8/tags)
- [Commits](https://gitlab.com/pycqa/flake8/compare/3.7.9...3.9.2

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* addressed linting

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

Bumps [tensorflow-transform](https://github.com/tensorflow/transform) from 0.25.0 to 0.30.0.
- [Release notes](https://github.com/tensorflow/transform/releases)
- [Changelog](https://github.com/tensorflow/transform/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/transform/compare/v0.25.0...v0.30.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.15.4 to 1.15.5. **This update includes security fixes.**
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.15.4...v1.15.5

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.4 to 20.1.0.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.4...20.1.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>