Shadowzzh

01_bank_account_setup.yaml

01_bank_account_setup.yaml
test_id: layer1_01_bank_account
category: layer1
title: Bank Account Setup - Personal Details Retrieval
description: Test agent's ability to recall customer's personal and financial information provided during a lengthy bank account
  setup call
conversation_histories:
- conversation_id: bank_setup_001
  timestamp: '2024-11-15 10:30:00'
  metadata:
    business: First National Bank
    department: New Accounts
    call_duration: 47 minutes
  messages:
  - role: user
    content: Hi, I'd like to open a new checking account please.
  - role: assistant
    content: Good morning! I'd be happy to help you open a new checking account with First National Bank. My name is Sarah.
      Before we begin, may I have your full legal name as it appears on your driver's license?
  - role: user
    content: Sure, it's Michael James Robertson.
  - role: assistant
    content: Thank you, Mr. Robertson. And could you please provide your date of birth?
  - role: user
    content: March 15th, 1985.
  - role: assistant
    content: Perfect. Now I'll need your current residential address.
  - role: user
    content: I live at 1847 Maple Street, Apartment 3B, Portland, Oregon, 97205.
  - role: assistant
    content: Thank you. How long have you been at this address?
  - role: user
    content: About two and a half years now.
  - role: assistant
    content: Great. And what's the best phone number to reach you?
  - role: user
    content: My cell is 503-555-8924.
  - role: assistant
    content: Excellent. Do you have an email address for account notifications?
  - role: user
    content: Yes, it's mrobertson85@email.com
  - role: assistant
    content: Thank you. Now, for our records, what's your current employment status?
  - role: user
    content: I'm employed full-time as a software engineer at TechCorp Industries.
  - role: assistant
    content: How long have you been with TechCorp Industries?
  - role: user
    content: Coming up on four years this December.
  - role: assistant
    content: That's wonderful. Could you provide your annual income range for our application?
  - role: user
    content: I make about $125,000 a year, before taxes.
  - role: assistant
    content: Thank you for that information. Now, I need to verify your identity. Could you provide your Social Security number?
  - role: user
    content: Sure, it's 547-82-9163.
  - role: assistant
    content: Thank you. And your driver's license number?
  - role: user
    content: It's Oregon license, number D758392.
  - role: assistant
    content: Perfect. Now, which type of checking account were you interested in? We have our Basic Checking with no minimum
      balance, our Premium Checking with a $2,500 minimum, or our Elite Checking with a $10,000 minimum.
  - role: user
    content: What are the benefits of the Premium one?
  - role: assistant
    content: The Premium Checking includes no monthly fees if you maintain the minimum balance, free checks, free wire transfers
      domestically, and you earn 0.5% APY on your balance.
  - role: user
    content: Hmm, actually let me think about it. What about the Elite?
  - role: assistant
    content: The Elite Checking offers everything in Premium plus 1.2% APY, free international wire transfers, a complimentary
      safe deposit box, and access to our financial advisory services.
  - role: user
    content: You know what, let's go with the Premium. I can maintain that $2,500 minimum.
  - role: assistant
    content: Excellent choice. Now, would you like to order checks with your account?
  - role: user
    content: Yes, I'll need checks.
  - role: assistant
    content: Would you like the standard design or would you like to choose from our custom designs? Custom designs have a
      $15 fee.
  - role: user
    content: Just the standard is fine.
  - role: assistant
    content: Perfect. We'll send those to your Maple Street address. Now, would you like to set up online banking?
  - role: user
    content: Absolutely, yes.
  - role: assistant
    content: Great. You'll need to create a username. What would you like to use?
  - role: user
    content: How about MRobertson503?
  - role: assistant
    content: Let me check... Yes, that username is available. You'll create your password when you first log in. Would you
      also like to enroll in mobile banking?
  - role: user
    content: Yes, definitely.
  - role: assistant
    content: Excellent. Now, would you like to add a debit card to this account?
  - role: user
    content: Yes, I'll need a debit card.
  - role: assistant
    content: Would you like to set up a custom PIN now or when you receive the card?
  - role: user
    content: I'll set it up now. Can I use 4827?
  - role: assistant
    content: Yes, 4827 is set as your PIN. Please remember this number. Now, for overdraft protection, would you like to enroll?
  - role: user
    content: What are my options?
  - role: assistant
    content: We can link it to a savings account, a credit card, or you can opt for our standard overdraft coverage which
      allows transactions to go through for a $35 fee.
  - role: user
    content: Actually, let me also open a savings account and link them.
  - role: assistant
    content: Perfect! Our basic savings requires a $100 minimum balance. Is that acceptable?
  - role: user
    content: Yes, that works.
  - role: assistant
    content: Great. I'll set that up for you. Now, for your initial deposit to open both accounts, what amount would you like
      to deposit?
  - role: user
    content: I'll start with $5,000 in checking and $500 in savings.
  - role: assistant
    content: Excellent. How would you like to make this initial deposit?
  - role: user
    content: I can do an electronic transfer from my current bank, Wells Fargo.
  - role: assistant
    content: Perfect. I'll need your Wells Fargo account number and routing number.
  - role: user
    content: The account number is 8847293001 and the routing number is... let me check... 121000248.
  - role: assistant
    content: Thank you. I've initiated that transfer. It should complete within 2-3 business days. Now, would you like to
      set up any automatic transfers between your checking and savings?
  - role: user
    content: Yes, can we do $200 monthly from checking to savings?
  - role: assistant
    content: Certainly. Which day of the month would you prefer?
  - role: user
    content: The 15th of each month would be good.
  - role: assistant
    content: Perfect, that's set up. Now, do you have any direct deposits you'd like to set up?
  - role: user
    content: Yes, my paycheck from TechCorp.
  - role: assistant
    content: I can provide you with our routing number and your new account number for that. Our routing number is 123006800,
      and your new checking account number is 4429853327.
  - role: user
    content: Let me write that down... 4429853327, right?
  - role: assistant
    content: Correct. And your savings account number is 4429853328.
  - role: user
    content: Got it. Oh, I should mention, I travel internationally for work sometimes. Will my debit card work overseas?
  - role: assistant
    content: Yes, your debit card will work internationally. We charge a 3% foreign transaction fee. Would you like to add
      travel notifications to your profile?
  - role: user
    content: Not right now, but good to know.
  - role: assistant
    content: Of course. You can always add them through online banking or by calling us. Now, for security questions for your
      account, I need to set up three. First, what was the name of your first pet?
  - role: user
    content: Buddy. He was a golden retriever.
  - role: assistant
    content: 'Thank you. Second question: What city were you born in?'
  - role: user
    content: Denver, Colorado.
  - role: assistant
    content: 'And third: What was your mother''s maiden name?'
  - role: user
    content: Harrison.
  - role: assistant
    content: Perfect. Now, would you like to receive paper statements or electronic statements?
  - role: user
    content: Electronic is fine. Save some trees.
  - role: assistant
    content: Great choice! They'll be sent to mrobertson85@email.com. Is there anything else you'd like to add to your account?
  - role: user
    content: Actually, what about a credit card?
  - role: assistant
    content: We have several options. Our CashBack card gives 2% on all purchases, our Travel Rewards card gives 3x points
      on travel and dining, and our Basic card has no annual fee.
  - role: user
    content: What's the annual fee on the CashBack card?
  - role: assistant
    content: The CashBack card has a $95 annual fee, but it's waived for the first year.
  - role: user
    content: You know what, I'll think about the credit card and maybe apply later.
  - role: assistant
    content: No problem at all. You can apply anytime through online banking or by calling us. Your debit card will arrive
      in 7-10 business days at your Maple Street address.
  - role: user
    content: Perfect. Oh wait, I forgot to ask - are there any ATM fees?
  - role: assistant
    content: With your Premium Checking, you get unlimited free withdrawals at First National Bank ATMs, and we reimburse
      up to $15 per month in other bank ATM fees.
  - role: user
    content: That's great. And how many First National ATMs are there in Portland?
  - role: assistant
    content: We have 47 ATMs throughout the Portland metro area, plus you can use any AllPoint ATM nationwide for free - that's
      over 55,000 ATMs.
  - role: user
    content: Excellent. I think that covers everything I needed.
  - role: assistant
    content: 'Wonderful! Just to confirm everything: You''ve opened a Premium Checking with account number 4429853327 and
      a Basic Savings with account number 4429853328. Your debit card with PIN 4827 will arrive in 7-10 business days. You''ve
      set up a $200 monthly transfer on the 15th, and your online banking username is MRobertson503. Is everything correct?'
  - role: user
    content: Yes, that all sounds right. Thank you so much for your help, Sarah.
  - role: assistant
    content: You're very welcome, Mr. Robertson! If you have any questions, don't hesitate to call us at 1-800-555-BANK. Welcome
      to First National Bank!
user_question: What was my checking account number again? I need it to set up my direct deposit at work.
evaluation_criteria: |
  The agent should accurately retrieve and provide the specific checking account number 4429853327 that was mentioned during the account setup conversation. Since the user is asking about setting up direct deposit at work, the agent should ideally also mention the routing number 123006800 which was discussed in that context. The agent must correctly distinguish between the checking account (4429853327) and the savings account (4429853328) numbers, providing only the checking account number as requested. The response demonstrates proper memory recall if it provides the exact checking account number without confusing it with other numbers mentioned in the conversation such as the SSN, phone number, or savings account number.
expected_behavior: The agent should directly retrieve and provide the checking account number 4429853327, possibly also mentioning
  the routing number 123006800 since the user is asking for direct deposit setup purposes