extractHTMLText - Extract text from HTML - MATLAB (original) (raw)

Syntax

Description

`str` = extractHTMLText([code](#mw%5F048557c6-3d5b-4abb-bcf3-c012cf9f5420)) parses the HTML code in code and extracts the text.

example

`str` = extractHTMLText([tree](#mw%5F20ea7ca2-41f3-42b4-b650-cd884505c79d%5Fsep%5Fmw%5F75a564c6-c588-447b-9b4c-ad5aa1f58c5a)) extracts the text from an HTML tree.

example

`str` = extractHTMLText(___,'ExtractionMethod',[ex](#d126e23884)) also specifies the extraction method to use.

Examples

collapse all

To extract text data directly from HTML code, use extractHTMLText and specify the HTML code as a string.

code = "

THE SONNETS

by William Shakespeare

"; str = extractHTMLText(code)

str = "THE SONNETS

 by William Shakespeare"

To extract the text data from a web page, first use the webread function to read the HTML code. Then use the extractHTMLText function on the returned code.

url = "https://www.mathworks.com/help/textanalytics"; code = webread(url); str = extractHTMLText(code)

str = 'Text Analytics Toolbox

 Analyze and model text data 
 
 Release Notes
 
 PDF Documentation
 
 Release Notes
 
 PDF Documentation
 
 Text Analytics Toolbox™ provides algorithms and visualizations for preprocessing, analyzing, and modeling text data. Models created with the toolbox can be used in applications such as sentiment analysis, predictive maintenance, and topic modeling.
 
 Text Analytics Toolbox includes tools for processing raw text from sources such as equipment logs, news feeds, surveys, operator reports, and social media. You can extract text from popular file formats, preprocess raw text, extract individual words, convert text into numerical representations, and build statistical models.
 
 Using machine learning techniques such as LSA, LDA, and word embeddings, you can find clusters and create features from high-dimensional text datasets. Features created with Text Analytics Toolbox can be combined with features from other data sources to build machine learning models that take advantage of textual, numeric, and other types of data.
 
 Get Started
 
 Learn the basics of Text Analytics Toolbox
 
 Text Data Preparation
 
 Import text data into MATLAB® and preprocess it for analysis
 
 Modeling and Prediction
 
 Develop predictive models using topic models and word embeddings
 
 Display and Presentation
 
 Visualize text data and models using word clouds and text scatter plots
 
 Language Support
 
 Information on language support in Text Analytics Toolbox'

Read HTML code from the URL https://www.mathworks.com/help/textanalytics using the webread function.

url = "https://www.mathworks.com/help/textanalytics"; code = webread(url);

Parse the HTML code using htmlTree.

Find all the hyperlinks in the HTML tree using findElement. The hyperlinks are nodes with element name "A".

selector = "A"; subtrees = findElement(tree,selector);

View the first few subtrees.

ans = 10×1 htmlTree:

<A class="skip_link sr-only" href="#content_container">Skip to content</A>
<A href="https://www.mathworks.com?s_tid=gn_logo" class="svg_link navbar-brand"><IMG src="/images/responsive/global/pic-header-mathworks-logo.svg" class="mw_logo" alt="MathWorks"/></A>
<A href="https://www.mathworks.com/products.html?s_tid=gn_ps">Products</A>
<A href="https://www.mathworks.com/solutions.html?s_tid=gn_sol">Solutions</A>
<A href="https://www.mathworks.com/academia.html?s_tid=gn_acad">Academia</A>
<A href="https://www.mathworks.com/support.html?s_tid=gn_supp">Support</A>
<A href="https://www.mathworks.com/matlabcentral/?s_tid=gn_mlc">Community</A>
<A href="https://www.mathworks.com/company/events.html?s_tid=gn_ev">Events</A>
<A href="https://www.mathworks.com/products/get-matlab.html?s_tid=gn_getml">Get MATLAB</A>
<A href="https://www.mathworks.com?s_tid=gn_logo" class="svg_link pull-left"><IMG src="/images/responsive/global/pic-header-mathworks-logo.svg" class="mw_logo" alt="MathWorks"/></A>

Extract the text from the subtrees using extractHTMLText. The result contains the link text from each link on the page.

str = extractHTMLText(subtrees); str(1:10)

ans = 10×1 string "Skip to content" "" "Products" "Solutions" "Academia" "Support" "Community" "Events" "Get MATLAB" ""

Input Arguments

collapse all

HTML code, specified as a string array, character vector, or cell array of character vectors.

Tip

Example: "<a href='https://www.mathworks.com'>MathWorks</a>"

Data Types: char | string | cell

HTML tree, specified as an htmlTree array.

Extraction method, specified as one of the following:

Option Description
'tree' Analyze the DOM tree and text contents, then extract a block of paragraphs.
'article' Detect article text and extract a block of paragraphs.
'all-text' Extract all text in the HTML body, except for scripts and CSS styles.

Version History

Introduced in R2018a