SemanText

The corpus is the collection of documents you analyze. Use one or more of the four tabs in step 01:

Keyword

Type any keywords and choose Scrape articles. SemanText collects article URLs from news search, then scrapes each one at the edge. Up to 45 URLs are fetched per round.

URL list

Paste article URLs, one per line, and choose Scrape URLs. The first 45 URLs are processed per round; repeat to add more.

CSV upload

Upload one or more corpus files in the SemanText CSV format. Files are merged locally; there is no upload to a server. The expected columns are Datetime, Title, Text, URL, TextID, Publication.

Raw text

Paste text directly, or upload .txt files. Each submission becomes a single document and is limited to 100,000 tokens; the token counter under the box shows your position and blocks submissions over the limit. Date-like tokens such as6/9/2026 are kept intact by the tokenizer.

Step 02 shows your corpus:

• Documents: number of imported articles or raw text submissions.
• Tokens: total word tokens across the corpus.
• Sources: distinct publications or sources present.

The table below the metrics lists every document with its publication date, title, source, URL, and scraping status. UseExport corpus CSV to save the whole corpus.

Scraping statuses

• ok: article text was extracted.
• blocked: the site refused access (bot gate, HTTP 403/429) or returned a JavaScript shell.
• empty: the page loaded but contained no extractable article text.
• error: the request failed (for example, a network error).

Word frequency

Choose the number of top words and selectRun. Punctuation is removed, Indonesian stopwords are filtered using the built-in stopword list, and the result is shown as a ranked table and bar chart. Date-like tokens such as6/9/2026 are preserved as single tokens.

N-gram analysis

Set n (2 to 8) and select Run to get the most frequent multi-word sequences.

Concordance (KWIC)

Enter a keyword and select Run to see every occurrence with its left and right context. Matching is case-insensitive and word-based: searching presidendoes not match presidential.

Every analysis tool offers an Export CSV button that downloads the current result. Exports include:

• mostfrequentwords_by_semantext.csv
• n_gram_by_semantext.csv
• concordance_by_semantext.csv
• corpus_by_semantext.csv (full corpus, re-importable)

The corpus export uses the columnsDatetime, Title, Text, URL, TextID, Publication, so it can be merged again later with the CSV upload tab.

• Analysis stays local. Frequency, n-gram, and concordance computation never leave your browser.
• Scrape politely. SemanText fetches articles sequentially with a browser-like user agent. Respect therobots.txt of each site, attribute every source, and be mindful of copyright and Indonesian press-law norms when reusing scraped text. Scraped corpora are research artifacts: keep the original URLs so sources stay verifiable.
• Free-tier caps. The free deployment handles about 100,000 requests per day, with at most 45 article fetches per scrape round.