Newlines in prompts, python<3.12 support, parallel patched requests

[bjj]

Sorry I didn't split this up, but things don't seem so fancy yet that it's necessary.

Thanks for getting the ball rolling. I was going to do something similar so it was interesting to try it out.

[Contextualist]

👋Hi @bjj , thanks for your PR!

1. 59abc91 Explicit newline is natively supported. e.g.

   [[prompt]]
   name = "multiline-example"
   chat = """
   system: You are an assistant.
   user: Could you answer the following questions?
   a. 1+1=?
   b. 1^1=?
   assistant: I'm not sure.
   user: Which part is unclear?
   """

   I'll make it clearer in the example.
2. 239610b Sorry that I'm a bit opinionated on this one. I expect user to be able to create a new Python 3.12 virtual environment for installation.
3. 78e72ea Batching is nice! I will take a closer look soon.
4. 10fdff0 This is probably a confusion. model[_].name is just an internal tag (i.e. it will not get sent to the endpoint), and it should not be confused with model[_].model.

Let me know if you have further questions/comments on 1, 2, 4, otherwise please open a new PR with 3.

[bjj]

1. Ah, I misread the code. I see how it works now.
2. Ok
3. Feel free to cherry pick or not.
4. I ended up matching them to model names which causes them to be used as filenames (which is not immediately obvious to a user).

[Contextualist]

Closed as I cherry-picked 78e72ea as a4cea86. Thank you again for taking time navigating through the code and making improvements. A pair of fresh eyes means a lot to me for figuring out what doesn’t make sense. There will be follow-up documentation enhancement based on your feedback on 1 and 4.