Pool deactivates inactive connections without respect to min size

[khoben]

• asyncpg version: 0.27.0
• PostgreSQL version: 14.6
• Do you use a PostgreSQL SaaS? If so, which? Can you reproduce
  the issue with a local PostgreSQL install?: No
• Python version: 3.11.1
• Platform: Windows/Linux
• Do you use pgbouncer?: No
• Did you install asyncpg with pip?: Yes
• If you built asyncpg locally, which version of Cython did you use?: -
• Can the issue be reproduced under both asyncio and
  uvloop?: Yep

Using a pool with max_inactive_connection_lifetime parameter releases connections without respect to min_size.
I expect that the number of active connections should be maintained up to min_size, using the connection refresh mechanism when pool.min_size > pool.size.