Recommendation · MoneyPull all debugging data sources — traces, evaluations, annotations, APM traces, codebase, JIRA tickets — into one area to reduce manual debugging time from hours/days to minutes. Bring in human annotations to understand where the agent could improve, APM traces to check whether the system is up or down, and the codebase so the agent can identify which code changes fix broken tool calls and pathways.
AI Engineer · Let Your Agent Cook: Using Skills to Evaluate and Improve Your App — Ankur Duggal, Arize AI
Method · MoneyIn the Graph Academy workshop, skip the introductory sections (like 'what is generative AI?') and jump down to the GraphRAG section; if you need the introductory generative AI material, going through it is perfectly fine as well. Navigate to the 'GraphRAG for Python' link in the left sidebar of the Graph Academy course. In the GraphRAG for Python section, scroll down and click 'Open in GitHub Codespaces'. When opening the GitHub Codespace, you may have to sign in to GitHub if you're not already signed in. Leave all the system prompts the same when creating the GitHub Codespace for the workshop. Create a copy of the env.example file when setting up the workshop environment. The workshop uses graphacademy.com as the starting link for the Graph Academy session. The GraphRAG for Python page 9
Method, not a verified protocol.
AI Engineer · RAG Needs a Map: Using GraphRAG to Retrieve Connected Context — Nyah Macklin, Neo4j
Method · MoneyCreate a free Graph Academy account at graphacademy.neo4j.com to access the workshop materials, and visit dev.neo4j.com/workshop-services-gen-ai-dash-notes for all workshop links and notes. Create a free Neo4j Aura instance specifically for the workshop — use the free instance rather than a paid professional one. Copy down or save the provided OpenAI API key for later use. Navigate to graphacademy.com and open the GraphRAG workshop, skipping the introductory sections and going directly to the GraphRAG section. Raise your hand during the workshop if you have questions and a colleague will come help at your table.
Method, not a verified protocol.
AI Engineer · RAG Needs a Map: Using GraphRAG to Retrieve Connected Context — Nyah Macklin, Neo4j
Method · MoneyOpen another window so you can leave your agent running, or close your agent for a minute and go to the query window. Paste the vector index into the Cypher query window and run it. Running the vector index creation command shows the vector index that has been created. If the vector index creation command reports it already exists, that means it was already run successfully.
Method, not a verified protocol.
AI Engineer · RAG Needs a Map: Using GraphRAG to Retrieve Connected Context — Nyah Macklin, Neo4j
Method · MoneyOn the GraphRag for Python page, find all credentials needed for the examples, scroll down and click 'Open in GitHub Codespaces'. Sign in to GitHub if not already signed in, leave all the system prompts the same, and create the Codespace. Create a copy of the env.example file, then create a .env file and paste the credentials into it instead of using the .env.example file.
Method, not a verified protocol.
AI Engineer · RAG Needs a Map: Using GraphRAG to Retrieve Connected Context — Nyah Macklin, Neo4j
Recommendation · MindBostrom argues that a short delay (weeks to months) at the moment a key AI breakthrough lands can be highly valuable: a few extra weeks to test everything properly and crank capability increases up gradually could produce a large reduction in risk.
attributed
The a16z Show · Nick Bostrom: How Should We Navigate Superintelligence?
Recommendation · MoneyTo get compute access, you fill out a request form and then receive an API key for the cluster.
AI Engineer · https://www.youtube.com/watch?v=Ndp5VaqFrl0
Recommendation · MoneyJesse Hall encourages the audience to run their own agents through the same benchmark used in the talk to catch surprises and get their scores, and to let LiveKit know how their agents perform.
AI Engineer · Latency Is a Budget. Humanlike Is the Goal. — Jesse Hall, LiveKit
Recommendation · BodyThe air bike is a big favorite for conditioning because it allows pushing specific conditioning with absolutely zero technique. You're in fixed fulcrums with fixed feet and hands, so you can't do it wrong — all you can do is not go as fast or go too hard. Any athlete, even the speaker's parents in their late 60s, can go to town on it straight away. Unlike 400s or hill sprints, you don't need to be good at sprinting to get conditioning benefit.
Garage Strength · How To Get Strong and Still Be Athletic w/ Sika Strength
Recommendation · MoneyThe creator notes that the biggest challenge with compliance agents is that they always start in the repo where the agent lives, so they may lack permissions in other repositories; the fix is to actually start the agent in the other repo so it has permissions there.
AI Engineer · From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Recommendation · MoneyThe creator recommends the Orchestrate command in the Copilot app as horizontal scaling for cross-repo work: set GitHub issues as goals, spin up sub-agents in the repository they're supposed to be working in, and keep pre-canned agents on task in individual repositories.
AI Engineer · From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Recommendation · MoneyThe creator recommends setting up an alert so that every time an agent exceeds its P90 for expected cost to run, it goes to investigate why it exceeded its threshold and reports debugging information for further evaluation or improvement.
AI Engineer · From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Recommendation · MoneyThe creator recommends that when a tool call is failing over and over, you A-B test different front matter or different models to see if they produce the right output, so you can pick a cheaper model.
AI Engineer · From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Recommendation · MoneyThe creator recommends pulling pre-built pipeline agents off the shelf from the GitHub Next organization's Agentix project — around 30 different agents including code deduplication and various reviewer agents (QA reviewer, joke-making reviewer) — and dropping them into your pipeline rather than building from scratch.
AI Engineer · From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Recommendation · MoneyYou can ask Codex to read the repo and dive really deep into how the harness and app server work behind the scenes, look at the actual system prompt of Codex in the repo, and fork the open-source harness and app server to make it your own.
AI Engineer · Building on the Codex Harness — Dominik Kundel, OpenAI
Recommendation · MoneyDominik Kundel recommends using dynamic tools to expose additional functionality to the agent, such as game actions like granting armor, health, or weapons.
AI Engineer · Building on the Codex Harness — Dominik Kundel, OpenAI
Recommendation · MoneyOn a per-thread basis you can modify any other configuration for your agent, such as setting a different model provider, choosing a different model, or fine-grained sandbox control over network connections and which files it can modify.
AI Engineer · Building on the Codex Harness — Dominik Kundel, OpenAI
Recommendation · MoneyDominik Kundel notes you can connect the Codex harness to any other model provider with a Responses API compatible API, and use Codex from within Claude Code via a plugin that uses the same app server and harness behind the scenes.
AI Engineer · Building on the Codex Harness — Dominik Kundel, OpenAI
Recommendation · MoneyWith the app server protocol, apps can offer sign-in with ChatGPT so users bring their own ChatGPT subscription and usage goes off their Codex usage limit. If you've used something like T3 code or similar, you were already using this through the app server protocol.
AI Engineer · Building on the Codex Harness — Dominik Kundel, OpenAI
Recommendation · MoneyPedro Lopez advises against MCP elicitation for connecting tools and credentials. Elicitation is a spec feature for requesting information from the user; form mode is not applicable for sensitive data like API credentials, and URL mode — recently available and similar to Airbyte's link-based credential flow — has the problem of inconsistent client support (Claude Desktop doesn't support it), forcing Airbyte to do its own thing.
AI Engineer · Designing CLIs for Agents, Not Humans — Pedro Lopez, Airbyte