Mdthbs

Previously, I asked the question Search For Three Consecutive Words to get almost similar books from a booklist. The idea was, if two strings have three similar consecutive words then they will be considered almost duplicate.

I got a good solution from there. The solution is given bellow.

I am using the following AWK Script (script.awk).

NR == FNR {

        gsub("[[:punct:]]", "")



        for (i = 3; i <= NF; ++i)

                w[$(i-2),$(i-1),$i]++



        next

}



{

        orig = $0

        gsub("[[:punct:]]", "")



        for (i = 3; i <= NF; ++i)

                if (w[$(i-2),$(i-1),$i] > 1) {

                        print orig

                        next

                }

}

The input data (TestData.txt) is -

$ cat TestData.txt 

7L: The Seven Levels of Communication

Numbers Guide: The Essentials of Business Numeracy by Richard Stutely

The MVP Machine: How Baseball's New Nonconformists Are Using Data to Build Better Players

Freakonomics: A Rogue Economist Explores the Hidden Side of Everything by Steven Levitt

Superfreakonomics by Steven Levitt

Moneyball by Michael Lewis

Money Master the Game by Tony Robbinson

Zen and the Art of Motorcycle Maintenance: An Inquiry into Values

Impossible to Inevitable by Jason Lemkin

How to Sell Your Way Through Life by Napoleon Hill

Venture Deals by Brad Feld & Jason Mendelson

Envisioning the Survey Interview of the Future

Brave Leadership: Unleash Your Most Confident, Powerful, and Authentic Self to Get the Results You Need

Dealers of Lightning: Xerox PARC and the Dawn of the Computer Age

The Seven Levels of Communication: Go From Relationships to Referrals by Michael J. Maher

How to Be a Power Connector: The 5+50+100 Rule for Turning Your Business Network into Profits by Judy Robinett

Lean Startup by Eric Ries

The E-Myth Revisited

The Power of Broke

The Four Steps to the Epiphany by Steve Blank

The Art of the Start

Growth Juice by John A. Weber

Man's Worldly Goods: The Story of the Wealth of Nations by Leo Huberman

The Wealth of Nations by Adam Smith

A History of Central Banking and the Enslavement of Mankind

A History of Money and Banking in the United States: The Colonial Era to World War II

The History of Banking: The History of Banking and How the World of Finance Became What it is Today

The Federal Reserve: What Everyone Needs to Know

The Federal Reserve and its Founders: Money, Politics, and Power

America's Bank: The Epic Struggle to Create the Federal Reserve

The Power and Independence of the Federal Reserve

America's Money Machine: The Story of the Federal Reserve

Too Big to Fail by Andrew Ross Sorkin

Business - Later - Read Review To Confirm

Blogging for Your Business

Liar’s Poker by Michael Lewis

Sensemaking: The Power of the Humanities in the Age of the Algorithm, by Christian Madsbjerg.

Giftology: The Art and Science of Using Gifts to Cut Through the Noise, Increase Referrals, and Strengthen Retention, by John Ruhlin.

Getting Real by the people at Basecamp

Venture Deals by Brad Feld 

To get the duplicate books I am giving the command awk -f script.awk TestData.txt TestData.txt.

The output is -

$ awk -f script.awk TestData.txt TestData.txt 

7L: The Seven Levels of Communication

Freakonomics: A Rogue Economist Explores the Hidden Side of Everything by Steven Levitt

Superfreakonomics by Steven Levitt

Moneyball by Michael Lewis

Venture Deals by Brad Feld & Jason Mendelson

The Seven Levels of Communication: Go From Relationships to Referrals by Michael J. Maher

The Power of Broke

Man's Worldly Goods: The Story of the Wealth of Nations by Leo Huberman

The Wealth of Nations by Adam Smith

A History of Central Banking and the Enslavement of Mankind

A History of Money and Banking in the United States: The Colonial Era to World War II

The History of Banking: The History of Banking and How the World of Finance Became What it is Today

The Federal Reserve: What Everyone Needs to Know

The Federal Reserve and its Founders: Money, Politics, and Power

America's Bank: The Epic Struggle to Create the Federal Reserve

The Power and Independence of the Federal Reserve

America's Money Machine: The Story of the Federal Reserve

Liar’s Poker by Michael Lewis

Sensemaking: The Power of the Humanities in the Age of the Algorithm, by Christian Madsbjerg.

Venture Deals by Brad Feld 

However, I have a little problem. The Problem is -

Here,

7L: The Seven Levels of Communication AND The Seven Levels of Communication: Go From Relationships to Referrals by Michael J. Maher

are almost duplicate and should be together.

Again,

Moneyball by Michael Lewis AND Liar’s Poker by Michael Lewis

should be together.

Once More,

Venture Deals by Brad Feld & Jason Mendelson AND Venture Deals by Brad Feld

should be together. But they are not. You get the idea :)

What can I do so that the almost similar books are adjacent to each other.