How to Hire a Cold Email Agency: 9 Questions to Ask First

Why the Right Questions Matter More Than the Right Price

Cold email agencies are everywhere. A quick search returns dozens of options, all promising meetings on your calendar within 30 days. The pitch decks look similar. The pricing falls in the same range. The case studies all show impressive numbers.

The problem is that cold email has a wide range of execution quality, and most of the differences are invisible until you are 60 days into an engagement. By then you have spent 6,000 to 15,000, your sending domains may be burned, and your brand has been attached to copy you never approved.

We have run outbound campaigns for over 50 B2B companies. The pattern is consistent: the buyers who vet agencies on operational specifics end up in stronger engagements than those who choose based on price or promises alone. The 9 questions below are the ones that separate agencies who build pipeline from those who burn through your budget.

Cold Email Agency

A service provider that manages outbound email campaigns on behalf of a business. The agency typically handles list building, sending infrastructure, email copywriting, deliverability management, reply handling, and reporting. The goal is to start conversations with qualified prospects and convert them into booked sales meetings. Unlike marketing agencies that run ads or SEO, cold email agencies focus exclusively on 1-to-1 prospecting at scale.

Question 1: Who Owns the Sending Infrastructure?

This is the single most revealing question you can ask. The answer tells you how the agency thinks about deliverability, which is the foundation that everything else sits on.

A strong agency sets up dedicated sending domains and mailboxes specifically for your campaigns. They register the domains, configure SPF, DKIM, and DMARC, warm up each mailbox over 14 to 21 days, and monitor sender reputation throughout the engagement. When you ask who owns the infrastructure, the answer should be clear: either you own the domains and they manage them, or they own the domains and transfer them to you on exit.

The red flag is an agency that sends from shared infrastructure. If your emails go out from the same domains and IPs as 20 other clients, one bad actor tanks deliverability for everyone. Your open rates drop. Your emails hit spam. And you have no control over it because the problem is not your campaign, it is someone else's.

Even worse: some agencies send from your primary business domain. If those cold emails trigger spam complaints, your company email, the one your team uses for client communication, gets flagged. We covered the technical details of domain setup and warmup in our deliverability guide.

Question 2: How Do You Build and Verify the Prospect List?

List quality determines reply rates more than copy quality does. A perfectly written email sent to the wrong person is a waste. A decent email sent to the right person at the right time books meetings.

Ask the agency to walk through their list building process step by step. Where do they source data? How do they filter for your ideal customer profile? Do they verify email addresses before sending? What is their bounce rate threshold?

Strong agencies use multiple data sources (Apollo, ZoomInfo, LinkedIn Sales Navigator) and cross-reference them. They verify every email address through a dedicated verification service before it enters a campaign. Their bounce rate stays under 2 percent. They can show you a sample list before the first email sends so you can validate targeting accuracy.

Weak agencies scrape a list, do minimal verification, and blast it. You find out when bounce rates hit 8 percent, spam complaints spike, and your sending domains get flagged. According to Salesforce research, B2B data decays at roughly 30 percent per year. An agency that does not verify data is sending to addresses that may not exist.

Question 3: Can I See the Actual Emails Before They Send?

This question reveals how the agency handles copy and approval workflows. Some agencies write copy once, get approval, and run it unchanged for months. Others write copy and send it without approval at all. Neither approach is ideal.

The best agencies write multiple variants, test them against each other, and iterate based on reply data. But they also give you visibility into what is going out. You should be able to see the actual emails, with personalization filled in, before they hit inboxes. Your brand is attached to every message. You should know what it is saying.

Ask specifically about personalization depth. There is a spectrum. At one end, the agency swaps in first name and company name and calls it personalized. At the other end, they research each prospect individually and write custom opening lines based on their company, role, and recent activity. Most strong agencies land somewhere in between: templated structure with researched personalization per prospect.

The question is not "do you personalize?" Every agency says yes. The question is "show me 3 example emails from a recent campaign, with the actual personalization, so I can see the depth." If they cannot produce examples, they are not doing the work they claim.

Question 4: What Does Your Reporting Look Like?

Reporting separates accountable agencies from those that operate in a black box. You need visibility into campaign health, not just results.

At minimum, weekly reports should include:

• Emails sent (total and per campaign)
• Open rate (target: 45 percent or higher)
• Reply rate (target: 3 percent or higher for cold outbound)
• Positive reply rate (what percentage of replies are interested)
• Meetings booked
• Bounce rate (should stay under 2 percent)
• Domain health and sender reputation metrics

If an agency only reports meetings booked, you are flying blind. Open rates tell you whether your subject lines and sender reputation are healthy. Reply rates tell you whether the copy resonates. Bounce rates tell you whether the list is clean. Without these leading indicators, you cannot diagnose problems until they have already cost you weeks of pipeline.

Ask the agency for a sample report from a current client (with identifying details removed). If they cannot produce one, that tells you reporting is not a core part of their operation. We detailed what strong reporting looks like in our guide to done-for-you cold email.

Question 5: What Happens When a Prospect Replies?

Reply handling is where many engagements break down. A prospect responds positively, and then nothing happens for 48 hours because the agency's reply process runs on a manual queue.

Speed matters in outbound. A positive reply is a narrow window of interest. The prospect was intrigued enough to respond, but they are also busy and will forget about your email by tomorrow. The difference between replying in 5 minutes and replying in 5 hours can be the difference between a booked meeting and a dead thread.

Ask the agency: who handles replies? What is the average response time? Do positive replies get routed to you immediately, or does the agency respond first and then loop you in? Is there a classification system for reply types (positive, objection, question, not interested)?

The best agencies classify every reply, respond to positive and objection replies within minutes, and route qualified prospects directly to your calendar. The worst let replies sit in a shared inbox until someone checks it during business hours.

Question 6: What Is the Contract Structure?

Contract terms reveal how confident an agency is in their ability to deliver. Confident agencies offer month-to-month contracts with 30-day notice. They know that strong results keep clients around. They do not need lock-in periods to protect revenue.

If an agency requires a 6-month or 12-month commitment with no performance clause, ask why. Sometimes there is a legitimate reason: enterprise programs with complex setup may need a 90-day minimum to produce meaningful data. But if the explanation is vague, it usually means the agency has a retention problem and is solving it with contracts instead of results.

Key terms to negotiate before signing:

1. Minimum commitment length. Month-to-month is ideal. 90-day minimum with a performance exit clause is acceptable for more complex engagements.
2. Performance clause. Define specific KPIs (meetings booked, reply rates) that trigger an exit option if not met within a defined window.
3. Data ownership. Clarify who owns the prospect lists, email copy, campaign data, and sending domains. You should be able to take everything with you if the engagement ends.
4. Ramp period. The first 30 days are infrastructure setup and warmup. Billing during ramp should reflect this. Some agencies offer reduced rates for the first month.

We broke down the full range of pricing models and contract structures in our outbound lead generation pricing guide.

Question 7: How Do You Handle Deliverability Long-Term?

Deliverability is not a one-time setup. It requires ongoing management. Domains age. Sending patterns shift. Email providers update their spam filters. An agency that sets up infrastructure in week 1 and never touches it again will see performance degrade over time.

Ask the agency what their ongoing deliverability management looks like. Specifically:

• Do they rotate sending domains periodically?
• How do they monitor sender reputation across mailboxes?
• What happens when a domain gets flagged or blacklisted?
• Do they adjust sending volume based on engagement signals?
• Do they use inbox placement testing (tools like GlockApps or MailReach) to verify emails are landing in primary?

The agency should have a clear protocol for domain rotation, blacklist monitoring, and volume throttling. According to Validity's 2025 deliverability report, roughly 1 in 6 legitimate emails never reaches the inbox. For cold outbound, that number is higher. An agency without a deliverability management process is losing a significant portion of your campaigns to spam folders.

Sender Reputation

A score assigned by email service providers (Gmail, Outlook, etc.) to a sending domain or IP address based on historical sending behavior. Factors include bounce rates, spam complaint rates, engagement metrics, and sending volume consistency. A low sender reputation causes emails to land in spam or get blocked entirely. It takes 2 to 4 weeks to build reputation on a new domain and minutes to destroy it with poor sending practices.

Question 8: Do You Have Case Studies in My Industry?

Industry experience is not a requirement, but it is a strong signal. An agency that has run campaigns for B2B SaaS companies understands the buying cycle, the typical objections, and the messaging angles that resonate. An agency entering your industry for the first time needs to learn all of that on your budget.

Ask for 2 to 3 case studies from companies similar to yours in industry, deal size, and target audience. Then go one step further: ask if you can speak with those clients directly. A confident agency makes the introduction. An agency with inflated case studies hesitates.

If the agency cannot provide references or the references do not match the case study numbers, that gap tells you everything you need to know.

Question 9: What Does the First 30 Days Look Like?

The onboarding process is a preview of how the agency operates. A structured 30-day plan signals discipline. A vague "we will get started next week" signals an agency that wings it.

A strong first 30 days typically follows this sequence:

1. Week 1: Kickoff meeting. ICP definition and targeting criteria. Sending domain registration and DNS configuration. Initial list building begins.
2. Week 2: Domain warmup starts (14 to 21 day process). Copy drafts delivered for review. Sample prospect list delivered for targeting validation.
3. Week 3: Copy approved and loaded. Warmup continues. Reply handling process confirmed. Reporting dashboard set up.
4. Week 4: First campaigns go live at conservative volume. Initial data starts flowing. First weekly report delivered.

Any agency that promises emails sending in week 1 is skipping the warmup process, which means they are either using pre-warmed shared infrastructure (risky) or sending from cold domains (guaranteed deliverability issues). The 2 to 3 week ramp is not a delay. It is the investment that makes months 2 through 6 productive.

We outlined what strong onboarding and the full agency experience looks like in our guide to outsourcing cold email.

Putting It All Together: The Vetting Scorecard

You do not need a perfect score across all 9 questions. But the pattern of answers tells you what kind of agency you are dealing with.

An agency that owns the infrastructure, writes personalized copy, reports transparently, handles replies fast, offers flexible contracts, manages deliverability proactively, provides verifiable case studies, and runs a structured onboarding is an agency that has built their operation around long-term client success. They keep clients because the system works, not because the contract says you cannot leave.

An agency that deflects these questions, gets vague on specifics, or pushes you toward signing before answering them is an agency that relies on sales rather than delivery. The pitch might be compelling. The execution will not be.

Cold email works. It is one of the fastest channels for B2B pipeline generation. But the agency you choose determines whether that channel produces qualified meetings or burns through your sending infrastructure and leaves you starting over in 90 days. The 9 questions above take 30 minutes to ask. The wrong agency choice costs months.