Skip to main content

How To "Engineer" Your Unstructured Data

Engineers are all about  structure. Especially civil engineers. I should know. I'm married to one. It's fascinating (and boring at times) to know how much research is done just to build a road, tunnel, or bridge. That includes sample testing, design, and quality assurance to ensure the dirt below the foundation is structurally stable enough to build on and to make recommendations on which materials to use. Failure to do so will result in major catastrophes and lower the quality of life in  particular environments. My husband loves to tell people that "engineers saves more lives than doctors."

Taking everything I've soaked in about engineering I thought about how we as researchers may apply it to the research industry. Obviously the more structure we have in place the more efficient we will be in gathering, segmenting, and analyzing data as well. With the growth of the internet and social media marketing many companies are wondering how to better understand what clients are saying when they are leaving comments on the company blog or speaking to them via Twitter or Facebook. "How can I compare my open-ended comment answers from a survey with what Facebook fans are saying?"

In the old days text analysis will be out-sourced to a research firm with a coding department where actual people would thumb through paper surveys that were sent in the mail and mark/sort them according to the categories set forth by the client. These days new text analytics technologies are popping up everywhere to fill the void and cut costs while allowing analysts more control over the process. Trend watchers say text analytics technologies is one of the top 15 trends to watch in the next 3 years.

If you are interested in learning more about this growing trend and want to know more about how to bring "structure" to your unstructured data I urge you to join us for tomorrow's webinar:

Tuesday 1/18/10 at 9:00 AM PST

Unlock the Power of Text Analysis with DiscoverText

Dr. Stu Shulman, President and CEO of Texifter, LLC, will present the following:

* How to augment your research with powerful, time-saving text tools
* Import thousands of documents from various sources and formats
* Discover information using powerful software and human techniques
* How easy it is to get started!

We will then show you an example using existing data from SurveyAnalytics and how easy it is to send your text files to DiscoverText, set-up codes, and reporting capabilities.

The session with conclude with a Question and Answer Session.
All slides and recording of webinar will be available on within 24 hrs of the presentation.

Space is limited so register today:

About The Presenter:

Dr. Stuart Shulman, CEO and founder of Texifter, LLC is a spin-out company based on text analysis research He is also the founder of QDAP-Pitt and current Director of QDAP-UMass. Over the last 10 years, Dr. Shulman has conducted research primarily in the domain of electronic rulemaking, with a specific focus on the development of human language tools for reviewing large numbers of public comments. Over the past three years, he has been sole inventor on five distinct software applications that support tasks ranging from text classification, blog capture, and manuscript review management, to the development of better annotation for improving optical character recognition. New research focuses on the detection of threats and novel ideas communicated in public comments, blogs and other media. Texifter is a vehicle for the commercialization of new tools developed in the QDAP labs.


Popular posts from this blog

Results of the Presidential Job Index Survey (week ending 7/1/2010)

Quick update on the results for the presidential job index survey for the week ending 7/1/2011. As a reminder this is a weekly survey that we conduct and we publish the results for the survey every Friday. To participate in this week's survey, please download the SurveySwipe application and take the survey.

Remember, you get points that you can redeem for various rewards when you take our surveys. We have already distributed several paid apps like Angry Birds for free.


Almost 900 respondents took the survey.
52% vs 53% last week of the respondents approve of the job that President Obama is doing.
Respondents included 28% Democrats (31% last week), 25% Republicans (22% last week), 24% independents (27%) last week and 2% with the Green Party (3% last week).

You can view the reports here or directly on your phone.

Top 5 Infographics of the Week: Cyber Security

Earlier this week, we experienced a power outage with our data center at Internap. During this short period of time, our customers were unable to access the site. Luckily, it didn't last long and we are back up and running now thanks to our dedicated support team that responded quickly and worked diligently.

Cyber security is, and always has been, a very important issue for us as we continue to grow and meet the demands of a technology-driven society. Nothing is more paramount than the safety of your valuable data. And apparently we weren't the only ones affected, as LinkedIn was experiencing difficulties on the same day and Internap had 3 massive outages earlier this year. Check out these infographics with stats on the importance of cyber security and the impact it can have on small-medium sized businesses.

Top 5 Infographics of the Week: Internet of Things

In 2008, the number of things connected to the internet exceeded the number of people on Earth. By 2050, we are expected to surpass 50 million different devices connected to the internet. And we're not just talking smartphones and tablets - we mean everything. Wearable tech, household appliances, smart homes, public transportation, hospitals and even cattle have all been using sensors to transmit data automatically. It is an exciting yet scary time to be alive. The various interactions between these different entities are opening up doors for more apps, more software and more auxiliary services. With so many "things" connected online, the possibilities for information exchange becoming wider everyday. Check out the top 5 infographics to learn more about the IoT.