Studied a bit more about peltier module. Found this helpful diagram that illustrates how Peltier component is double sided and can change the cool/heat side by changing the direction of the current flow.
Here is the link to the source.
Interestingly, it seeemed like people have been attempted to make DIY AC using peltier modules. I found several youtube videos that uses petlier modules to make a window mount AC or a large surface cooler. (Interestingly, it seems like you can also make icecream with since it can reach below zero temperatre quickly with the cool side)
Here is a link to the DIY AC made with peltier modules.
I realized I should probably start thinking:
1. what should I do with the cool side?
2. I might need a heat exchanger using liquid or solid medium to evenly distribute the warmth