Industry Commentary →

Andrew Ng's AI Skills Map Is Accurate. Most Organizations Have No Idea How to Use It.

Andrew Ng's The Batch Issue #366 maps what AI engineering competency actually looks like in 2026. The map is correct. The problem is that most mid-market organizations don't have the internal reference point to translate it into hiring criteria, onboarding, or performance benchmarks.

Andrew Ng’s The Batch Issue #366 presents a structured map of AI engineering competency with a direct argument: AI has changed the craft of software development so fundamentally since 2022 that traditional hiring criteria and learning paths are now obsolete. The issue also covers ongoing model price competition across OpenAI, DeepSeek, and Meta — a data point that reinforces the central claim. As model costs decline, the competitive advantage shifts from access to models toward the ability to build and operate reliably with them.

Ng’s skills map is accurate. The framing is correct. The problem is not the map. The problem is that most mid-market organizations do not have the internal reference point to use it as a hiring tool — and without that reference point, the map produces better-looking job descriptions, not better hires.

quadrantChart
title AI Engineering Skills by Organizational Priority
x-axis Low Current Team Readiness --> High Current Team Readiness
y-axis Low Business Criticality --> High Business Criticality
quadrant-1 Critical gap — hire or contract now
quadrant-2 Invest with dedicated program
quadrant-3 Deprioritize for now
quadrant-4 Train internally — best ROI
AI system evaluation and testing: [0.25, 0.88]
RAG architecture and retrieval: [0.35, 0.82]
AI cost and latency optimization: [0.4, 0.75]
Prompt engineering and iteration: [0.72, 0.6]
Tool integration and API use: [0.7, 0.55]
Model fine-tuning and training: [0.2, 0.45]

The Map Exists. The Translation Layer Doesn’t.

When Ng publishes a skills taxonomy, the people who can immediately use it are the ones who already have enough technical depth to read it precisely. They know which items correspond to real differentiated capability and which are surface-level familiarity most engineers can pick up in a week. They know which skills are table stakes by 2026 and which are still genuinely rare. They know how to write a job description that actually tests for what matters.

Most mid-market hiring managers do not have that context. What they have is a list of skills that looks complete and authoritative — and a process for writing job descriptions that is essentially unchanged from 2020.

The result is predictable. Job descriptions for AI engineering roles in 2026 tend to either over-specify — demanding graduate-level ML knowledge for roles that need solid API integration and evaluation skills — or under-specify, treating “experience with AI tools” as a sufficient criterion for roles that require genuine systems thinking about model reliability, cost management, and failure modes. Both errors are expensive. The over-specified role goes unfilled for months or attracts the wrong candidates. The under-specified hire ships something fragile.

For the Working Software Engineer: Where the Actual Demand Is

The skills that matter most right now are not the ones with the most tutorials. They are the ones that close the gap between a model running in a demo and a system running reliably in production.

Specifically: evaluation and testing frameworks for AI outputs, retrieval-augmented generation architecture, cost and latency optimization across model providers, and the judgment to design AI system boundaries that fail gracefully rather than silently. These are in relatively short supply because they require real system-building experience, not just model familiarity.

The model price competition Ng’s issue covers — OpenAI, DeepSeek, and Meta all moving on pricing — means the cost barrier to building with AI is declining. The barrier that remains is integration and production competency. Engineers who can demonstrate that they have shipped AI systems that actually work at the operational level — not just in a proof of concept — are the ones with durable market value right now.

That credential does not come from a certification or a course. It comes from having been responsible for a system in production, with real users and real failure consequences.

For Business Owners: You Need a Benchmark, Not Just a Job Posting

If you are trying to hire or evaluate AI engineering talent in 2026 and you do not have someone on the team with the judgment to distinguish real competency from credential accumulation, you will make expensive mistakes in both directions.

The challenge is not finding candidates who list AI skills. Every resume in this market does. The challenge is evaluating which candidates can build systems that work in production — not just demos — and which ones understand the operational requirements that make AI production-ready: monitoring, fallback logic, cost governance, and human-in-the-loop design for the decisions that cannot be fully automated.

This is not an HR problem. It is a technology leadership problem. The hiring criteria have to come from someone who has built and operated these systems. No job description framework, including a well-constructed skills map, can substitute for that judgment at the evaluation stage.

My Take: The Benchmark Problem Has Always Been the Real Challenge

At LERETA, where I led over 30 developers through a multi-year modernization program valued at more than $20 million, one of the persistent challenges was distinguishing technical candidates who understood the actual architecture from candidates who could speak fluently about the right concepts without the practical depth to execute.

This is not a new problem — it exists in every technical hiring market — but the AI wave has made it significantly harder. The vocabulary is new enough that almost anyone can sound credible in an interview by using the right terms. The practice is real enough that the gap between someone with genuine production experience and someone with tutorial-level familiarity shows up fast once they are in the role.

At LERETA, the architects who drove the most progress were not the ones with the most impressive credentials. They were the ones who had built complex systems under real constraints, made decisions that could not easily be undone, and managed the consequences. That judgment is what the engagement actually required. The formal qualifications mattered less than the pattern of decisions someone had made under pressure.

The skills map Ng publishes is a useful framework for people who already know which questions to ask. For organizations that don’t, the map still needs a translation layer — and that translation is a judgment call requiring someone who has actually built AI systems in a production environment, managed a technical team through the delivery, and observed what actually breaks.

That judgment is what most mid-market organizations are buying when they hire for AI engineering now. The skills map tells you what to look for. It does not tell you how to evaluate it. That is the gap worth closing before the first offer goes out.

Frequently Asked Questions

What does Andrew Ng's AI skills map say about the state of software engineering in 2026?

The Batch Issue #366 argues that the craft of software development has changed so fundamentally since 2022 that traditional hiring criteria and learning paths are now obsolete. The map identifies categories of competency — AI system evaluation, retrieval-augmented generation architecture, prompt engineering, model cost and latency optimization, tool integration, and fine-tuning — and positions them relative to what engineering roles actually require in a production environment. The parallel coverage of model price competition across OpenAI, DeepSeek, and Meta reinforces the framing: as model cost drops, the skill premium shifts from 'access to models' toward 'ability to build and operate reliably with them.'

Why can't most mid-market companies use the AI skills map as a hiring tool?

The map tells you what to look for. It does not tell you how to evaluate it. Mid-market hiring managers who do not have hands-on AI production experience cannot distinguish a candidate with genuine system-building competency from a candidate with tutorial-level familiarity and the right vocabulary. Both look similar in a standard technical interview. Both list the same skills on a resume. The difference shows up in the first few months in the role — when the system needs to handle edge cases, when the cost structure turns out to be wrong, when the evaluation framework was never built and nobody knows if the model is actually working. That judgment call — distinguishing real from fluent — requires someone who has built and operated these systems, not just studied them.

What does an organization need before it can hire AI engineering talent effectively?

At minimum: a clear description of what the system needs to do in production, a list of the failure modes that would be unacceptable, and someone on the evaluation team who can ask technical questions that distinguish real production experience from polished answers about theoretical capability. Without that last piece, the hiring process defaults to resume filtering and interview performance — neither of which reliably predicts whether an AI engineering hire will ship something that works. Organizations that don't have this internal capability internally should either build it before hiring (by bringing in temporary technical leadership to design the evaluation process) or accept that they are likely to make one or two expensive mistakes before calibrating.

Shawn Livermore — Fractional CTO & Chief AI Officer
About the Author

Shawn Livermore

Fractional CTO and Chief AI Officer with nearly 3 decades of enterprise architecture experience. Clients include Kelley Blue Book, LERETA ($18B property tax processor), First American Financial, Carvana, WellPoint/Anthem, and PacifiCare. 92 client reviews, 5-star average.

View full background →

Need a fractional CTO or CAIO?

Technology leadership without the full-time headcount. Engagements start with a conversation.

Man writing a flowchart diagram on a whiteboard with a blue marker.