ERP Selection Guide

The Complete Guide to Choosing an ERP for Mid-Market Companies

Requirements gathering, vendor evaluation, total cost of ownership analysis, and implementation planning — a practical framework for CFOs navigating a high-stakes selection decision.

By CFOTechStack Editorial Team  |  Published: March 2026  |  Last reviewed: March 2026  |  2,400 words · 11 min read

ERP selection is among the most consequential decisions a CFO will make. Unlike a point solution that handles one function, an enterprise resource planning system becomes the central nervous system of a business — touching finance, operations, supply chain, and often HR and manufacturing simultaneously. When selections go well, companies gain years of operational leverage. When they go poorly, the costs are severe: failed mid-market ERP implementations routinely run $500,000 to $2 million or more when you factor in sunk vendor fees, consulting overruns, opportunity cost, and the organizational disruption of starting over.

The reasons selections fail are well documented. Companies talk to vendors before defining requirements. They optimize for price instead of fit. They underestimate implementation complexity. They choose the ERP but ignore the implementation partner, who often determines the actual outcome. This guide is a systematic framework for avoiding those mistakes — walking through the selection process from initial scoping through business case construction, with particular attention to the decisions that most commonly go wrong.

75%
Mid-market companies still on legacy systems or spreadsheets
$2M+
Cost of a failed ERP implementation at 500+ employee companies
18–24mo
Typical full ERP deployment timeline for mid-market

Understanding the Mid-Market ERP Landscape

The mid-market is broadly defined as companies with $50 million to $1 billion in annual revenue, though the operational complexity of a $50M manufacturer can exceed that of a $300M professional services firm. What unites mid-market buyers is a set of shared constraints: they need enterprise-grade functionality, but lack the internal IT resources and budget of a large enterprise. They've outgrown QuickBooks and basic accounting software, but are not yet ready for SAP's full suite complexity.

The primary vendors competing for mid-market ERP share include:

Understanding where each vendor excels — and where they struggle — is essential context before entering any selection process. Vendor strengths are not universal; they are industry- and use-case-specific.

Step 1 — Define Your Requirements Before Talking to Vendors

This is the single most important step in the process, and the one most frequently skipped. Companies schedule vendor demos before they have completed a requirements document, which means they end up evaluating vendors on the vendor's terms rather than their own. Vendors are skilled at making their software look capable of almost anything in a demo. The only way to cut through that is to arrive with documented requirements that force the vendor to demonstrate specific functionality against your actual business processes.

Functional Requirements

Document the functional requirements for each module area that will be in scope. For most mid-market companies this includes: core financial management (GL, AP, AR, fixed assets), consolidations and multi-entity reporting, procurement, inventory and warehouse management (if applicable), manufacturing and production (if applicable), project accounting (if applicable), and HR/payroll (if you want an HCM module or need integration with an existing HCM). For each functional area, identify the specific processes, transaction volumes, and reporting needs that matter most.

Non-Functional Requirements

Non-functional requirements are as important as functional ones and are often underweighted. These include: cloud vs. on-premise deployment preference, scalability requirements (where will this company be in five years?), integration requirements with existing systems (CRM, e-commerce, payroll, bank feeds), security and compliance requirements (SOC 2, HIPAA, government contracting), and performance requirements for report generation and transaction processing at peak periods.

Current Pain Points Inventory

Document the specific pain points driving the evaluation. Are monthly close processes taking longer than two weeks? Are finance teams maintaining parallel spreadsheets because the existing system can't handle consolidations? Is there no real-time visibility into inventory? Explicit pain points become the baseline against which you measure whether a new system solves the actual problem.

Critical rule: No vendor demos until your requirements document is complete and signed off by all department stakeholders. Once you start demos, the anchoring effect of what you've seen influences what you think you need. Document requirements in isolation first.

Step 2 — Establish Selection Criteria and Weighting

Before evaluating any vendors, define the criteria by which they will be scored and the relative weight of each criterion. This prevents post-hoc rationalization of decisions made for unstated reasons (often price). A standard mid-market ERP weighting framework:

Criterion Weight What to Measure
Functional fit 40% Demo scoring against scripted requirements; gap analysis
Total cost of ownership (5-year) 25% License/subscription + implementation + internal resources + ongoing support
Implementation complexity and support 20% Partner quality, go-live timeline, training, change management support
Vendor stability and product roadmap 15% Financial health, R&D investment, customer retention rates, roadmap alignment

These weights should be adjusted for your specific situation. If your company has a complex technical integration environment, weight implementation complexity higher. If you are in a capital-constrained growth phase, TCO may carry more weight.

Step 3 — Build Your Vendor Longlist and Shortlist

A structured vendor identification process prevents both overlooking strong candidates and wasting time on poor fits. To build a longlist, draw on: analyst reports (Gartner Magic Quadrant, Forrester Wave, G2 reviews), peer networks and CFO communities, industry associations, and formal RFI responses from vendors. An RFI (Request for Information) is a short document you send to 8–12 vendors asking structured questions about their capabilities, typical customer profile, and rough pricing ranges.

From the longlist, narrow to 3–4 shortlisted vendors for in-depth evaluation. The shortlisting process should disqualify vendors that fail any of these criteria: no reference customers in your industry at your approximate revenue scale, inability to meet a must-have functional requirement, pricing that clearly exceeds budget ceiling even at the low end, or deployment model incompatibility (e.g., you require cloud and the vendor is primarily on-premise).

Three to four vendors is the right shortlist size. More than four creates evaluation fatigue for your team and signals to vendors that you are not a serious buyer, which can affect the quality of attention and pricing you receive.

Step 4 — The Demo and Evaluation Process

Generic vendor demos are largely useless for selection purposes. Vendors are practiced at showing their software in the best possible light through carefully sequenced workflows. The only demos that produce useful evaluation data are scripted demos — where you provide the vendor with a specific scenario document and require them to demonstrate your actual business processes, with your actual data where possible.

Scripting the Demo

Provide each vendor with a scenario document two weeks before the demo. The document specifies 8–12 business process scenarios drawn from your requirements document: how a multi-entity consolidation is prepared, how an intercompany transaction is recorded and eliminated, how a purchase order approval workflow is configured, how a manufacturing job order is tracked through the system. The vendor must demonstrate each scenario live — not a slide deck, not a pre-recorded video.

Stakeholder Involvement

Include subject matter experts from each department in the relevant demo sections. Your controller should score the financial management demo, your supply chain manager should score the procurement demo. Decentralized scoring with defined criteria is more reliable than a single evaluator's impressions.

Reference Checks

Require each shortlisted vendor to provide 3–5 reference customers in your industry and revenue range. Ask references: How long did implementation take versus what was scoped? What was the final cost versus initial quote? What has post-go-live support been like? Would you select this vendor again? What do you wish you had known before starting? The answers to the last question are often the most useful.

Evaluating ERP vendors for your mid-market company?

Browse ERP vendors in the CFOTechStack Marketplace — filtered by company size, industry, and deployment model.

Step 5 — Total Cost of Ownership Analysis

TCO analysis is the most frequently underestimated component of ERP selection. License fees are visible and easy to compare. Everything else — implementation costs, internal resource costs, training, data migration, customizations, and ongoing support — is often discovered after the contract is signed. Build a five-year TCO model before signing anything.

Cost Components

Cost Component 50–200 Employees 200–1,000 Employees
Annual subscription (Year 1) $40K–$120K $100K–$400K
Implementation partner fees $150K–$400K $400K–$1.2M
Internal resource cost (est.) $75K–$150K $200K–$500K
Data migration $20K–$50K $50K–$150K
Training $15K–$40K $40K–$100K
5-year estimated total $500K–$1.1M $1.2M–$3.5M

Step 6 — Selecting an Implementation Partner

In most mid-market ERP implementations, the implementation partner matters as much as — or more than — the software itself. A capable, experienced partner can navigate around product gaps. An inexperienced partner can turn a strong product into a failed project. This is not an exaggeration: the majority of ERP failure post-mortems identify implementation partner deficiencies as a primary cause.

Evaluate implementation partners separately from the software vendor. Just because a partner is certified by the vendor does not mean they are qualified for your specific industry or implementation scope. Key partner evaluation criteria: number of completed implementations at companies of your size and industry, average go-live timeline vs. scoped timeline for recent projects, team stability (will the people who sold you the engagement actually work on it?), and references from clients with similar complexity.

For a more detailed framework on partner selection, see the ERP Implementation Partner Selection Guide.

Red Flags in the ERP Selection Process

Certain vendor and process behaviors predict poor outcomes with reasonable reliability:

Building the Business Case for Your ERP Investment

The business case for an ERP investment must quantify both cost and benefit over a defined time horizon (typically five years). The cost side is covered by the TCO analysis above. The benefit side requires rigorous estimation of specific, measurable outcomes — not vague claims about "operational efficiency."

Common quantifiable benefits in mid-market ERP implementations include: reduction in monthly close cycle time (a close that goes from 15 days to 7 days frees up meaningful finance team hours annually), elimination of parallel spreadsheet maintenance (track hours spent maintaining off-system data and value them), reduction in inventory carrying costs through better visibility (usually 5–15% of inventory value), accounts payable early-payment discount capture that was previously missed due to manual processes, and reduction in external audit fees driven by improved controls and audit-ready financials.

Build the financial model conservatively. Assign probabilities to benefit realizations, discount for time to full adoption, and present a base case, upside case, and downside case to your board or executive team. An ERP investment with a payback period longer than four to five years deserves additional scrutiny of either the cost structure or the benefit assumptions.

Common Mistakes Mid-Market CFOs Make

Ready to start your ERP selection?

Browse the CFOTechStack Vendor Directory for pre-screened ERP vendors — or get personalized recommendations based on your company profile.