[SPARK-44133][PYTHON] Upgrade MyPy from 0.920 to 0.982

### What changes were proposed in this pull request?

This PR upgrade MyPy version from 0.920 to 0.982.

### Why are the changes needed?

To detect type related changes better by static analysys.

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

```bash
./dev/linter-python
```

Closes #41690 from HyukjinKwon/SPARK-44133.

Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>

Author: HyukjinKwon

.github/workflows/build_and_test.yml

@@ -624,7 +624,7 @@ jobs:
         #   See also https://github.com/sphinx-doc/sphinx/issues/7551.
         # Jinja2 3.0.0+ causes error when building with Sphinx.
         #   See also https://issues.apache.org/jira/browse/SPARK-35375.
-        python3.9 -m pip install 'flake8==3.9.0' pydata_sphinx_theme 'mypy==0.920' 'pytest==7.1.3' 'pytest-mypy-plugins==1.9.3' numpydoc 'jinja2<3.0.0' 'black==22.6.0'
+        python3.9 -m pip install 'flake8==3.9.0' pydata_sphinx_theme 'mypy==0.982' 'pytest==7.1.3' 'pytest-mypy-plugins==1.9.3' numpydoc 'jinja2<3.0.0' 'black==22.6.0'
         python3.9 -m pip install 'pandas-stubs==1.2.0.53' ipython 'grpcio==1.48.1' 'grpc-stubs==1.24.11' 'googleapis-common-protos-stubs==2.2.0'
     - name: Python linter
       run: PYTHON_EXECUTABLE=python3.9 ./dev/lint-python

dev/requirements.txt

@@ -20,7 +20,7 @@ openpyxl
 coverage
 
 # Linter
-mypy==0.920
+mypy==0.982
 pytest-mypy-plugins==1.9.3
 flake8==3.9.0
 # See SPARK-38680.

python/pyspark/ml/base.py

@@ -396,7 +396,7 @@ def setPredictionCol(self: P, value: str) -> P:
         """
         return self._set(predictionCol=value)
 
-    @property  # type: ignore[misc]
+    @property
     @abstractmethod
     @since("2.1.0")
     def numFeatures(self) -> int: