Pd.testing.assert_frame_equal имеет AssertionError с теми же типами dtypes ⇐ Python

[Anonymous]

import pandas as pd
import pyarrow as pa
import numpy as np
from datetime import datetime, timedelta

df = pd.DataFrame({
"product_id": pd.Series(
["PROD_" + str(np.random.randint(1000, 9999)) for _ in range(100)],
dtype=pd.StringDtype(storage="pyarrow")
),
"transaction_timestamp": pd.date_range(
start=datetime.now() - timedelta(days=30),
periods=100,
freq='1H'
),
"sales_amount": pd.Series(
np.round(np.random.normal(500, 150, 100), 2),
dtype=pd.Float64Dtype()
),
"customer_segment": pd.Series(
np.random.choice(['Premium', 'Standard', 'Basic'], 100),
dtype=pd.StringDtype(storage="pyarrow")
),
"is_repeat_customer": pd.Series(
np.random.choice([True, False], 100, p=[0.3, 0.7])
)
})

def types_mapper(pa_type):
if pa_type == pa.string():
return pd.StringDtype("pyarrow")

df = df.convert_dtypes(dtype_backend="pyarrow")
df_pa = pa.Table.from_pandas(df).to_pandas(types_mapper=types_mapper)
pd.testing.assert_frame_equal(df, df_pa)

Типы dtypes кажутся одинаковыми, но я получаю следующую ошибку.
AssertionError: Attributes of DataFrame.iloc[:, 0] (column name="product_id") are different

Attribute "dtype" are different
[left]: string[pyarrow]
[right]: string[pyarrow]


Подробнее здесь: https://stackoverflow.com/questions/793 ... ame-dtypes