Show HN: Arch – an intelligent prompt gateway built on Envoy
Hi HN! My name is Adil Hafeez, and I am the Co-Founder at Katanemo and the lead developer behind Arch - an open source project for developers to build faster, generative AI apps. Previously I worked on Envoy at Lyft.Engineered with purpose-built LLMs, Arch handles the critical but undifferentiated tasks related to the handling and processing of prompts, including detecting and rejecting jailbreak attempts, intelligently calling “backend” APIs to fulfill the user’s request represented in a prompt, routing to and offering disaster recovery between upstream LLMs, and managing the observability of prompts and LLM interactions in a centralized way - all outside business logic.Here are some additional key details of the project,* Built on top of Envoy and is written in rust. It runs alongside application servers, and uses Envoy's proven HTTP management and scalability features to handle traffic related to prompts and LLMs.* Function calling for fast agentic and RAG apps. Engineered with purpose-built fast LLMs to handle fast, cost-effective, and accurate prompt-based tasks like function/API calling, and parameter extraction from prompts.* Prompt guardrails to prevent jailbreak attempts and ensure safe user interactions without writing a single line of code.* Manages LLM calls, offering smart retries, automatic cutover, and resilient upstream connections for continuous availability.* Uses the W3C Trace Context standard to enable complete request tracing across applications, ensuring compatibility with observability tools, and provides metrics to monitor latency, token usage, and error rates, helping optimize AI application performance.This is our first release, and would love to build alongside the community. We are just getting started on reinventing what we could do at the networking layer for prompts.Do check it out on GitHub at https://github.com/katanemo/arch/
.Please leave a comment or feedback here and I will be happy to answer!
Comments URL: https://news.ycombinator.com/item?id=41864014
Points: 3
# Comments: 16
https://github.com/katanemo/arch
Show HN: High school robotics code/CAD/design binder release
Hello HN!My name is Patrick, and I am a junior at my High School’s FRC robotics team FRC 341 “Miss Daisy” (yes named after the movie). Every year, during the first weekend in January, a new robotics game is released (no it’s not battlebots). The game could be about launching balls into a goal, climbing monkeybars, or placing cubes on a see-saw. This year we were challenged to build a robot that could shoot orange foam donuts into a goal about 6 feet in the air. Here is a yt video with the game animation https://www.youtube.com/watch?v=9keeDyFxzY4&t
. After we received the game we then had six weeks to design, build, program, and field a robot capable of playing the game. And we did pretty well this year! I have attached a ChiefDelphi thread (robotics forum) where we have released our season materials. This being our CAD (3D model of robot), code, and design binder. I encourage you to take a look and leave any questions that you may have.Thanks a lot!
Comments URL: https://news.ycombinator.com/item?id=41340874
Points: 3
# Comments: 1
https://www.chiefdelphi.com/t/team-341-miss-daisy-2024-cad-code-and-design-binder-release/467546
Ask HN: What is it with all the spambots on HN?
Is it just me or there's been some sharp uptick in fresh (almost 100%) bot accounts posting stuff about me wanting an AI girlfriend and such?Is it some kind of coordinated flood attack? And is an AI girlfriend really a feasible idea?
Comments URL: https://news.ycombinator.com/item?id=40125197
Points: 6
# Comments: 1
https://news.ycombinator.com/item?id=40125197
Oddbean new post about login | logout
Notes by Hacker News: Front Page (RSS Feed) | export