Hey Ipshita, did you try using Medium API?(https://mediumapi.com)

You can easily do this using this. Here's the reference article: https://pub.towardsai.net/medium-api-get-posts-using-python-126d6d859ca8

Nishu

PS: And if you're looking for a Medium Articles Dataset. Here's the biggest, most recent, rich dataset right here: https://mediumapi.gumroad.com/l/289k-MediumArticles-26-05-2023