Windows has a partition manager called Disk Management that can be launched by typing
diskmgmt.msc. However, this does not display any filesystem information for non-Windows partitions like
ext4. And there is no chance of using it to create partitions with non-Windows partitions.
MiniTool Partition Wizard is a free Windows tool that can be used to view partition information for all types of filesystems. You can also create or edit partitions of those types. I find it useful when I occasionally have to use dual-boot Windows machines to quickly find out all about its partitions.
Tried with: MiniTool Partition Wizard Home Edition 8.1.1 and Windows 7 Professional 64-bit