* Bump pylint from 2.8.3 to 2.10.2

Bumps [pylint](https://github.com/PyCQA/pylint) from 2.8.3 to 2.10.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.8.3...v2.10.2

)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* make installing dependencies more predictable

* downgrade numpy due to conflict with apache beam

* downgraded numpy further due to conflict with tensorflow

* linting: use dict literal

* linting: pass in encoding to open function

* linting: pcoll renamed to input_or_inputs

* linting: iterate over list

* linting: use from .. import

* added pyarrow as explicit dependency

* downgrade google-cloud-bigquery

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

Bumps [gevent](https://github.com/gevent/gevent) from 21.1.2 to 21.8.0.
- [Release notes](https://github.com/gevent/gevent/releases)
- [Changelog](https://github.com/gevent/gevent/blob/master/docs/changelog_pre.rst)
- [Commits](https://github.com/gevent/gevent/compare/21.1.2...21.8.0

)

---
updated-dependencies:
- dependency-name: gevent
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [apache-beam[gcp]](https://github.com/apache/beam) from 2.31.0 to 2.32.0.
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/beam/compare/v2.31.0...v2.32.0

)

---
updated-dependencies:
- dependency-name: apache-beam[gcp]
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.62.0 to 4.62.2.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](https://github.com/tqdm/tqdm/compare/v4.62.0...v4.62.2

)

---
updated-dependencies:
- dependency-name: tqdm
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [numpy](https://github.com/numpy/numpy) from 1.21.1 to 1.21.2.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt)
- [Commits](https://github.com/numpy/numpy/compare/v1.21.1...v1.21.2

)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [pip](https://github.com/pypa/pip) from 21.2.2 to 21.2.4.
- [Release notes](https://github.com/pypa/pip/releases)
- [Changelog](https://github.com/pypa/pip/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/pip/compare/21.2.2...21.2.4

)

---
updated-dependencies:
- dependency-name: pip
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

* initial create vocabulary utility

* extract vocabulary from embeddings

* renamed to --output-word-count-file

* added main call

* extracted iter_tokenized_tokens

* avoid empty tokens

* using tokenizer from delft

* optionally sort by count

* added file list support

* added support for remote files

* added limit argument

* added fsspec dependency

* optionally use multi threading or processing

* included full github link

* renamed to create_vocabulary

* moved to tools vocabulary

* filter embeddings

* renamed to embeddings

* using fsspec to open embeddings file when extracting

* use fsspec when filtering embeddings

* document tools

* added link to tools.md

* Bump apache-beam[gcp] from 2.28.0 to 2.29.0

Bumps [apache-beam[gcp]](https://github.com/apache/beam) from 2.28.0 to 2.29.0.
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/beam/compare/v2.28.0...v2.29.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* replaced mock with unittest.mock

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

Bumps [numpy](https://github.com/numpy/numpy) from 1.19.5 to 1.20.3.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt)
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.20.3

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

* removed usage of six

* removed six dependency

This reverts commit 612a2c3f.

* Bump pylint from 2.4.4 to 2.8.2

Bumps [pylint](https://github.com/PyCQA/pylint) from 2.4.4 to 2.8.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/master/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/pylint-2.4.4...v2.8.2

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* ignore lxml elemebt builder not callable

* addressed most linting issues

* ignore false positive unsubscriptable-object

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

* Bump flake8 from 3.7.9 to 3.9.2

Bumps [flake8](https://gitlab.com/pycqa/flake8) from 3.7.9 to 3.9.2.
- [Release notes](https://gitlab.com/pycqa/flake8/tags)
- [Commits](https://gitlab.com/pycqa/flake8/compare/3.7.9...3.9.2

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* addressed linting

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Daniel Ecer <de-code@users.noreply.github.com>

Bumps [tensorflow-transform](https://github.com/tensorflow/transform) from 0.25.0 to 0.30.0.
- [Release notes](https://github.com/tensorflow/transform/releases)
- [Changelog](https://github.com/tensorflow/transform/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/transform/compare/v0.25.0...v0.30.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.15.4 to 1.15.5. **This update includes security fixes.**
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.15.4...v1.15.5

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.4 to 20.1.0.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.4...20.1.0

)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>