Prompt caching for cheaper LLM tokens(ngrok.com)
268 points by samwho | 67 comments
268 points by samwho | 67 comments
180 points by alpaylan | 127 comments
103 points by todsacerdoti | 48 comments
24 points by matt_d | 2 comments
375 points by rbanffy | 81 comments
Blog post explaining how Python source code encoding declarations (PEP 263) can be abused to implement a preprocessor that transforms code before execution.