OpenAI O3 Mini와 DeepSeek의 에이전틱 활용 비교

2025년 1월 31일 기준으로 OpenAI는 차세대 추론 모델인 O3 Mini 모델을 출시했습니다. 전반적으로 OpenAI O3 Mini 모델은 이전 세대 추론 모델인 O1 모델과 비슷한 정확도를 가지면서도 15배 저렴합니다. 새로운 OpenAI O3 Mini 모델은 OpenAI의 출시 후 하루도 지나지 않아 FlowHunt에서 바로 이용할 수 있게 되었습니다. 이 블로그에서는 모델의 역량을 깊이 있게 분석하고 DeepSeek와의 성능을 비교합니다.

OpenAI O3 Mini vs DeepSeek 평가 기준

이번 평가는 채팅 입력, 채팅 출력, AI 생성기를 활용한 간단하면서도 효과적인 워크플로우를 통해 체스의 루이 로페즈(Ruy Lopez) 오프닝 주요 라인에 대한 명확하고 간결한 설명을 도출했습니다. DeepSeek와 O3 Mini의 성능을 비교하며, 각각이 1.e4 e5, 2.Nf3 Nc6, 3.Bb5 a6, 4.Ba4 Nf6, 5.O-O Be7 등의 핵심 수와 그 전개를 어떻게 처리하는지 평가했습니다. 이 비교 분석은 복잡한 체스 전략을 처리하고 전달하는 AI 도구의 역량을 보여주는 동시에, 대화형 흐름의 단순함이 읽기 쉬움과 실질적인 평가 결과를 얻는 데 얼마나 중요한지 강조합니다.

이것이 평가 플로우입니다:

DeepSeek 결과

모델에 다음과 같이 요청했습니다:
“Give me first 10 moves of Ruy Lopez.”
결과는 다음과 같습니다. DeepSeek의 사고 과정은 아래와 같습니다:

o3 mini vs deepseek Restarting session Please wait give me first 10 moves of ruy lopez
Okay, so I’m trying to figure out the first 10 moves of the Ruy Lopez opening in chess. I remember that the Ruy Lopez is one of the oldest and most popular openings, starting with the moves 1.e4 e5. Then, White plays 2.Nf3, developing the knight and preparing to control the center. Next, 2…Nc6, where Black develops their knight and supports the e5 pawn. Now, the Ruy Lopez proper starts with 3.Bb5, which attacks the knight on c6. I think this is the key move that defines the opening. Then, Black usually responds with 3…a6 to challenge the bishop. After that, White plays 4.Ba4, retreating the bishop to a safe square. So far, I have six moves: 1.e4 e5 2.Nf3 Nc6 3.Bb5 a6 4.Ba4. Now, Black’s next move is often 4…Nf6, developing the knight and attacking the pawn on e4. Then, White castles kingside with 5.0-0 to get the king to safety and bring the rook into the game. That’s eight moves. Next, Black might play 5…b5 to challenge White’s bishop on a4 and gain space on the queenside. Then, White responds with 6.c3, supporting the d4 push and preparing to develop other pieces. So, the tenth move would be 6…d6, solidifying the e5 pawn and preparing to develop the dark-squared bishop. Wait, but I’m not entirely sure if Black always plays 5…b5. Sometimes, they might play 5…Be7 instead, but I think 5…b5 is more common in the Closed Ruy Lopez. Also, after 6.c3, Black can choose between 6…d6 or 6…b5 again, but 6…d6 seems more standard to support e5. I should double-check the order to make sure I didn’t mix up any moves. Let me go through it again: e4 e5 Nf3 Nc6 Bb5 a6 Ba4 Nf6 0-0 b5 c3 d6 Yes, that seems correct. So the first ten moves are as I listed. I think that’s a solid foundation, but I’m a bit unsure if there are alternative lines Black might take earlier, like after 3.Bb5, maybe 3…g6 instead of 3…a6, but I think 3…a6 is the main line leading to the Morphy Defense. So, I’ll stick with that for the first ten moves. Foundation for both White and Black, with White aiming for a strong center and piece development, while Black challenges White’s bishop and prepares for further development.

최종 결과:

The first ten moves of the Ruy Lopez opening, following the Morphy Defense, are as follows:
e4 e5 Nf3 Nc6 Bb5 a6 Ba4 Nf6 0-0 b5 c3 d6
This sequence establishes a solid foundation for both White and Black, with White aiming for a strong center and piece development, while Black challenges White’s bishop and prepares for further development.

OpenAI O3 Mini 결과

O3 승. O3 Mini의 답변이 더 이해하기 쉽고 정확합니다.

The Ruy Lopez (or Spanish Game) is a rich opening with many variations. One of the most common ways to reach a classical Closed Ruy Lopez is with the following moves:
e4 e5 Nf3 Nc6 Bb5 a6 Ba4 Nf6 O-O Be7 Re1 b5 Bb3 d6 c3 O-O h3 Nb8 d4

Here’s a brief explanation of the ideas behind these moves:

• 1. e4 e5 sets up the classical battle for the center.
• 2. Nf3 develops a knight and attacks the e5 pawn; Black defends with Nc6.
• 3. Bb5 pins the knight on c6 (which is defending e5) and increases central pressure; Black challenges with a6.
• 4. Ba4 retreats while still keeping the pin; Black develops another piece with Nf6.
• 5. O-O secures White’s king; Black plays Be7 to prepare castling.
• 6. Re1 reinforces the central e4 pawn; Black’s b5 kicks the bishop and gains space on the queenside.
• 7. Bb3 preserves the bishop’s diagonal; Black shores up the center with d6.
• 8. c3 prepares to support a later d4 push while also preparing for a possible retreat of the bishop if needed, and Black castles with O-O.
• 9. h3 prevents any piece (like a knight or bishop) from coming to g4, where it could harass White’s center or pieces; Black retreats the knight with Nb8 to re-route it.
• 10. d4 is White’s break in the center, intending to challenge Black’s pawn structure.

Keep in mind this is just one of many valid move orders in the Ruy Lopez. Variations such as the Open Ruy Lopez or other lines in the Closed Ruy Lopez might differ after move 4 or later. But the sequence above is a well‐known path that many players follow in classical chess theory.

DeepSeek와 OpenAI O3 Mini의 에이전틱 행동 평가

2~3개의 도구가 필요한 에이전트 과제에 두 추론 모델을 평가했습니다. 과제는 다음과 같습니다:

회사명을 받아 제품의 가격 페이지를 검색하고 개선점을 제안하세요.
가격 페이지의 스크린샷도 촬영하세요.
그 후 결과를 포함해 저에게 이메일을 보내세요.

이 과제는 Google 검색을 통해 가격 페이지를 찾고, 해당 페이지를 크롤링한 뒤 이메일로 자세한 보고서를 전송해야 합니다.

모델의 추론 능력을 확인하기 위해 일부러 자세한 설명을 제공하지 않았습니다.

DeepSeek의 AI Agent 활용

DeepSeek는 이메일 발송에 실패했습니다. 전반적으로 DeepSeek는 도구 호출의 정확성 면에서 OpenAI GPT4o나 OpenAI O3 Mini 모델에 비해 부족하다는 점을 알 수 있었습니다. 아래는 DeepSeek가 FlowHunt의 가격 페이지를 분석하며 생성한 보고서와 그 과정의 사고 흐름입니다:

1. Google 도구 호출:

2. URL 크롤링:

추론 결과:

Subject: FlowHunt Pricing Page Review and Suggestions

Dear [Your Name],

I hope this message finds you well. Below is a summary of the FlowHunt pricing page, along with some suggestions for enhancements.

Pricing Overview:

FlowHunt offers four pricing tiers:

Starter Plan (€10/month):

• 10 Credits
• 5 Workflows per Workspace
• 1 Workspace
• 1 Team Member per Workspace
• 5 Chatbots per Workspace
• 2 Websites per Workspace
• 5 Documents per Workspace
• 50 FAQs per Workspace
• Access to All Latest OpenAI LLMs, Including Custom Fine-Tuned Models
• All Integrations
• Email Support

Pro Plan (€50/month):

• 55 Credits (Includes 10% Discount on Credits)
• 20 Workflows per Workspace
• 5 Workspaces
• 10 Team Members per Workspace
• 20 Chatbots per Workspace
• 10 Websites per Workspace
• 50 Documents per Workspace
• 100 FAQs per Workspace
• Access to All Latest OpenAI LLMs, Including Custom Fine-Tuned Models
• Pro Support
• API Key Access
• Basic Analytics (Coming Soon)
• All Integrations

Premium Plan (€500/month):

• 600 Credits (Includes 20% Discount on Credits)
• 50 Workflows per Workspace
• 10 Workspaces
• 100 Team Members per Workspace
• 50 Chatbots per Workspace
• 30 Websites per Workspace
• 100 Documents per Workspace
• 200 FAQs per Workspace
• Access to All Latest OpenAI LLMs, Including Custom Fine-Tuned Models
• Priority Support
• API Key Access
• Advanced Analytics (Coming Soon)
• Initial Workflow Consultation
• Initial Workflow Training Support
• All Integrations

Enterprise Plan (Custom Pricing starting from €1500/month):

• Contracted Tokens (Bring Your Own Key – BYOK)
• Unlimited Workflows
• Unlimited Workspaces
• Unlimited Users
• Unlimited Chatbots
• Unlimited Schedules
• Unlimited Documents
• Unlimited Questions and Answers
• Unlimited Chat History
• Access to All Latest OpenAI LLMs, Including Custom Fine-Tuned Models
• Dedicated Priority Support
• API Key Access
• Advanced Analytics (Coming Soon)
• Customizable Workflow Modules
• Optional Training Support
• Advanced Security and on-premises Deployment

Suggested Enhancements:

• Feature Comparison Table: Create a side-by-side comparison table highlighting the features of each plan. This would make it easier for users to quickly identify the differences between the plans.
• Customer Testimonials/Case Studies: Adding testimonials or case studies from existing customers can build trust and credibility.
• Pricing Calculator: Implement an interactive pricing calculator that allows users to estimate their costs based on their specific needs, especially for the Enterprise plan.
• Free Trial Highlight: Make the free trial option more prominent on the page to encourage users to try the service before committing to a paid plan.
• Detailed Documentation/Setup Guides: Provide links to detailed documentation or setup guides to help users understand how to make the most of the features included in each plan.

OpenAI O3 Mini의 AI Agent 활용

반면, 제한적인 설명만으로 OpenAI O3 Mini 모델은 정확한 프로세스를 스스로 해석해냈습니다:

1. Google 검색

2. URL 크롤링

3. 이메일 발송

제가 실제로 받은 이메일입니다:

Hello,

Below are the results of the review of FlowHunt’s pricing page and some suggested enhancements:

Pricing Page URL: https://www.flowhunt.io/pricing/

Screenshot: A screenshot of the pricing page was taken. (Please refer to the attached screenshot in your system.)

Summary of the Pricing Page:

The pricing page clearly displays four plans: Starter (€10/month), Pro (€50/month), Premium (€500/month), and Enterprise (from €1500/month). Each plan lists the credits, workflow and team limits, core features, and additional support options. The page includes both an overview and a detailed comparison using a table format, which helps potential customers compare the features across plans.

Suggested Enhancements:

• Interactive Pricing Calculator: Consider adding an interactive pricing calculator that allows users to adjust parameters (e.g., number of workflows, team members) to see a dynamic estimate of their monthly cost.
• Visual Enhancements and UX Improvements: Introduce more engaging visuals (e.g., icons or infographics) to further differentiate the features of each plan. Add subtle animations when hovering over different plan details to improve user interactivity.
• Currency Converter: Since pricing is in Euros, include a currency converter option to cater to international users for a better localized experience.
• Clearer Call-to-Action (CTA): Enhance the CTA buttons by making them more prominent and possibly adding a secondary CTA (e.g., “Learn More” about plan benefits) for users who need more clarity before signing up.
• Enhanced FAQ Section: Expand the FAQ section with more detailed answers regarding the credits system, potential overages, and common customer scenarios. Consider using collapsible sections to keep the page clean while providing additional information when needed.
• Social Proof and Testimonials: Incorporate customer testimonials or success stories near the pricing section to build credibility.
• Mobile Optimization: Ensure that the pricing table and all interactive elements render optimally on mobile devices.
• Chat Support Integration: Add an integrated live chat or chatbot support option on the pricing page to instantly address any queries related to pricing or plan details.

By implementing these enhancements, FlowHunt can provide a more engaging and user-friendly experience, potentially increasing conversion rates.

Best regards,
[Your Name]

(P.S. This email includes the results and suggestions for FlowHunt’s pricing page as well as information about the captured screenshot.)