# llms.txt - AI Model Crawling and Context Specification for Noviq

## Site Context and Purpose
x-site-purpose: "Noviq's corporate website provides technical information, product documentation, and industry insights for professionals in the AI and technology innovation sector."
x-site-description: "We are a technology company specializing in AI and innovation. Our website serves as both a product showcase and knowledge repository, with regularly updated blog content, documentation, and resources for our community."
x-primary-audience: "Technical professionals, developers, system architects, and business decision-makers in the AI and technology innovation space."
x-content-focus: "Technical documentation, industry analysis, product specifications, implementation guides, and thought leadership."

## Basic Settings
user-agent: *
x-content-license: "(c) Noviq, Inc. All rights reserved."
x-ai-training-policy: "allowed"
x-ai-quote-policy: "allowed-with-attribution"
x-content-attribution-format: "Source: Noviq, Inc. (https://noviq.jp)"

## Crawling Behavior
crawl-delay: 1
x-rate-limit: 60
x-rate-limit-window: 60
x-rate-limit-policy: "strict"
x-rate-limit-retry: "no-retry"
x-rate-limit-description: "Maximum 60 requests per 60 seconds. If rate limit is exceeded, do not retry and move on to next request."

## Concurrency Limitations
x-concurrency-limit: 3
x-concurrency-limit-description: "Please limit concurrent requests to a maximum of 3. This helps us manage server load and ensure consistent performance for all users."

## Error Handling and Retry Policy
x-error-retry-policy: "exponential-backoff"
x-error-retry-policy-description: "For transient errors (5xx except 429), implement exponential backoff with initial wait of 2 seconds, doubling on each retry, with maximum 5 retries."
x-rate-limit-exceeded-policy: "wait-and-retry"
x-rate-limit-exceeded-policy-description: "When receiving HTTP 429 (Too Many Requests), do not retry immediately. Wait at least 60 seconds before attempting the request again."
x-max-retries: 5
x-retry-status-codes:
  - 500
  - 502
  - 503
  - 504
x-no-immediate-retry-status-codes:
  - 429
x-no-retry-status-codes:
  - 403
  - 404

## Canonical URL Configuration
x-canonical-url-policy: "strict"
x-canonical-url: "https://noviq.jp/"
x-canonical-url-description: "Access via other FQDNs or IP addresses is invalid. Use only 'https://noviq.jp/' as the base URL. Within the HTML content, links should also start with 'https://noviq.jp/'"

## Site Architecture and Structure
x-site-architecture: "Our site follows a logical hierarchy with top-level sections for Products, Solutions, Resources, Blog, and Documentation. Each section has its own navigation structure and content patterns."
x-main-sections:
  - name: "Home"
    path: "/"
    description: "Noviq's homepage, showcasing our innovative solutions."
  - name: "About"
    path: "/about/"
    description: "Information about Noviq's mission and values."
  - name: "Column"
    path: "/column/"
    description: "Regular articles on industry trends, product updates, and technical insights."
  - name: "Privacy Policy"
    path: "/privacy-policy/"
    description: "Noviq's privacy policy and data handling practices."

## Content Types and Metadata
x-article-pattern: /column/article/{slug}/
x-article-type: "company-blog"
x-article-description: "Technical blog posts and business insights by Noviq, Inc. Articles cover technology trends, product updates, and industry insights."
x-article-example: https://noviq.jp/column/article/geo-vs-seo-differences-measures-analysis/
x-article-metadata:
  - author
  - title
  - description
  - published_date
  - updated_date
  - category
  - tags
x-article-update-frequency: "weekly"
x-article-new-articles-per-week: "1-3"
x-article-new-articles-per-week-description: "Approximately 1 to 3 new articles are added each week."

## Articles

### Difyで会話変数を簡単に使い倒す方法を解説。どのようなユースケースが効果的？
- URL: https://noviq.jp/column/article/dify-conversation-variable
- Description: 会話変数は、Dify内でユーザーとの対話中に特定の情報を一時的に保存し、後続の会話で参照できる機能です。  公式のドキュメントが若干わかりにくいので実例を元に解説します。
- Published: 2025-06-07T12:25:12.518Z
- Updated: 2025-06-08T12:15:16.556Z
- Tags: Dify
- Categories: Dify解説, 生成AI活用

### 【2024年11月最新】主要LLMの料金を徹底比較
- URL: https://noviq.jp/column/article/latest-october-2024-llm-prices-comparison
- Description: AI技術の進化とともに、さまざまな企業が提供する大規模言語モデル（LLM）のAPIを活用する機会が増えています。しかし、それぞれのモデルには料金体系や特徴が異なり、最適な選択をするためには慎重な検討が必要です。この記事では、Anthropic、OpenAI、Google Geminiの主要なLLM APIの料金と特徴を比較し、どのモデルがどのユースケースに適しているかを解説します。
- Published: 2025-06-07T12:25:12.428Z
- Updated: 2025-06-08T08:42:21.615Z
- Tags: Anthropic, Gemini, OpenAI
- Categories: 生成AI活用

### Difyの料金プランを解説。自社の用途に合ったプランの選び方とは?
- URL: https://noviq.jp/column/article/dify-pricing-plans-explained-how-to-choose-the-right-plan
- Description: Difyは、AIアプリケーション開発を簡素化するためのプラットフォームで、クラウド版、コミュニティ版、Premiumの3つの主要なオプションが提供されています。それぞれの特徴と利点を比較します。
- Published: 2025-06-07T12:25:12.332Z
- Updated: 2025-06-08T12:56:06.024Z
- Tags: Dify
- Categories: Dify解説

###  【業務でのLLM活用】LLMの回答精度を劇的に向上させる。ファインチューニングとRAGの違いとは？
- URL: https://noviq.jp/column/article/llm-optimization-finetuning-prompt-design-rag
- Description: LLM（大規模言語モデル）の活用を検討しているビジネスパーソンの方にとって、LLMからの回答の精度の向上は重要な課題かと思います。この記事では、LLMの精度を向上させるための主要なアプローチとして「ファインチューニング」「プロンプト設計」「RAG（検索による生成の拡張）」について、それぞれのメリットやデメリット、や違いを解説します。
- Published: 2025-06-07T12:25:12.241Z
- Updated: 2025-06-08T13:02:16.608Z
- Tags: OpenAI, Dify
- Categories: 生成AI活用

### LangchainとDifyの比較：誰にとっても使いやすいAIツールはどっち？
- URL: https://noviq.jp/column/article/which-ai-tool-is-easier-to-use-langchain-vs-dify
- Description: LangchainとDifyは、どちらもこのRAGを活用するツールでありながら、それぞれに特徴的な利点を持つ2つのプラットフォームです。この記事では、技術的な背景に詳しくない方でも理解しやすいように、これらのツールの違いや特徴を比較し、どちらがどのようなユーザーに適しているかを解説します。
- Published: 2025-06-07T12:25:12.143Z
- Updated: 2025-06-08T13:06:29.693Z
- Tags: Dify, LangChain
- Categories: 生成AI活用

### 【応用・拡張可能】DifyでGoogleの検索結果を取得し分析する方法を解説
- URL: https://noviq.jp/column/article/how-to-analyze-google-search-results-using-dify
- Description: 本記事では、Difyのフローの中でGoogleのCustomSearchJsonAPIを活用して、検索結果データをLLMに読み込ませることで、活用・分析する手法を解説します。
- Published: 2025-06-07T12:25:12.047Z
- Updated: 2025-06-08T13:24:12.599Z
- Tags: Dify, CustomSearchAPI
- Categories: 生成AI活用, 業務効率化, Dify解説

### RAGにおけるナレッジベースの仕組み：インデックス、検索、Rerankの関係をわかりやすく解説
- URL: https://noviq.jp/column/article/easy-guide-index-search-reranking
- Description: ナレッジベースの中で「インデックス」、「検索」、「Rerank」がどのように連携して回答を生成するのか、分かりやすく説明します。
- Published: 2025-06-07T12:25:11.950Z
- Updated: 2025-06-08T13:30:23.565Z
- Tags: Dify
- Categories: 生成AI活用, Dify解説

### DifyをXserverVPSを活用して格安で立ち上げる方法
- URL: https://noviq.jp/column/article/cost-effective-dify-deployment-using-xserver-vps
- Description: 自社でGCPやAWSでホスティングするまでのリソースや知見がない。。。という方には、格安でホスティングができるXserverのパッケージがおすすめです。
- Published: 2025-06-07T12:25:11.856Z
- Updated: 2025-06-08T13:49:35.246Z
- Tags: Dify, Xserver
- Categories: Dify解説

### Difyの公開アプリをBasic認証で特定の人に公開する方法︎
- URL: https://noviq.jp/column/article/how-to-restrict-public-dify-app-access-to-specific-users-with-basic-authentication
- Description: Difyの弱みは作成したアプリケーションなどの認証の部分にあります。  公開したアプリを特定の人にしか使えないようにしたいなどのニーズがあると思いますが、  DifyのSaaS版などでは対応することが難しく、自社でのホスティングにおいても個別に設定が必要です。
- Published: 2025-06-07T12:25:11.758Z
- Updated: 2025-06-08T14:04:20.358Z
- Tags: Xserver, Dify
- Categories: Dify解説

### GEO（Generative Engine Optimization）とは？SEOとの違いを調査してみる。
- URL: https://noviq.jp/column/article/geo-vs-seo-differences-measures-analysis
- Description: AI時代の検索最適化「GEO」とは？SEOとの違いや実践的な手法を徹底解説。論文の結果も深掘りし、コンテンツの可視性を高める方法を調査しました。
- Published: 2025-06-07T12:25:11.655Z
- Updated: 2025-06-09T07:06:07.800Z
- Tags: Genspark, Perplexity
- Categories: デジタルマーケティング, 生成AI活用

## Syndication and Discovery
x-feed: https://noviq.jp/feed/
x-feed-format: rss
x-feed-item-count: 20
x-feed-content: "latest"
x-feed-description: "The RSS feed contains the 20 most recent articles published on the site. It is updated whenever new content is published."
x-feed-update-frequency: "real-time"

## Site Navigation and Structure
x-sitemap: https://noviq.jp/sitemap.xml
x-sitemap-format: xml
x-sitemap-structure: "hierarchical"
x-sitemap-description: "Content is organized in type-specific sitemaps (products, blog, team, etc.). The main sitemap.xml is an index that references these specific sitemaps."
x-sitemap-retention: "permanent"
x-sitemap-retention-description: "All sitemaps are retained permanently, allowing access to complete content organization."

## Access Restrictions
disallow: /admin/*
disallow: /dashboard/*
disallow: /drafts/*
disallow: /private/*
disallow: /legacy/*
disallow: /api/internal/*
x-content-restrictions: "Some content may require authentication. AI models should not attempt to bypass authentication flows or access protected resources."

## Multi-language Support
x-supported-languages:
  - ja
x-default-language: "ja"
x-language-content-policy: "Content is provided in Japanese."

## Company Information
x-publisher-name: "Noviq, Inc."
x-publisher-description: "Noviq, Inc. is a technology company specializing in AI and innovation. We provide innovative solutions and share our expertise through our blog and knowledge base."
x-publisher-website: "https://noviq.jp/"

## Semantic Understanding Guidance
x-content-relationships: "Blog posts often reference documentation pages. Product pages link to related solutions and documentation. Understanding these relationships provides better context."
x-content-taxonomy:
  - primary_category
  - sub_category
  - topics
  - products
  - solutions
x-search-relevance-factors:
  - recency
  - authority
  - specificity
  - user_engagement

## Crawler Hints and Best Practices
x-crawler-hints:
  - "Before accessing each URL, check if the URL ends with '/'."
  - "If the URL does not end with '/', add '/' to the end of the URL before accessing it."
  - "Extract the HTML content of each page, paying attention to structured data in JSON-LD format."
  - "Respect the site's structure when retrieving content."
  - "When accessing documentation, maintain version context as specified in the URL path."
  - "Our site uses breadcrumb navigation which can provide helpful context about content hierarchy."
  - "Important content is typically found in the main article section, not in sidebars or footers."

## Content Freshness and Updates
x-content-update-policy: "Content is regularly reviewed and updated. Check the 'last_updated' field in page metadata for recency information."
x-deprecation-notices: "Deprecated content is marked with a banner and typically remains available for 12 months after deprecation."

## Generated Information
x-generated-date: "2026-07-14T00:51:07.402Z"
x-generator: "Noviq llms.txt Generator"
x-version: "1.0.0"