A complete, professional advertising service software to target large number of advertisers and publishers. Start running your own, google like advertising service today!
Inout Web Portal is a fully customizable and flexivle portal script and an optimal solution for seamlessly integrating various scripts from inoutscript.
Stay Informed
Subscribe to our newsletter
Hosting Recommendations
Are you looking for a reliable hosting service provider? We have prepared a list based on our client experience. Compare Hosting Services
From our Partner
Want to start a classifieds website for your community?
Try XZero Classifieds
Inout Spider One of the most powerful web spider softwares available on the net which works best for small/medium and large sized search engines. This script is base on PHP, MySQL and Hypertable database under Hadoop file system. This Inout Spider is capable enough to deal with huge amount of data and concurrent queries with high level of scalability, accuracy and speed. The scalability feature allows you to start small at low cost, with just a single server and later expand to multiple servers. Besides web search, Inout Spider provides image and news search. It will help you to use Inout Spider as your ultimate search data source for your portal/search engine.
Optimal for small, medium sized search engines: Inout Spider is a powerful, efficient, reliable and secure data source for even very large sized search engines, at the same time you can use it for small/medium size applications with the same efficiency. If you want to start a search engine for your own country, or if you want the search engine specifically for a theme(eg: music, sports, soccer etc), Inout Spider works best for you. If you can provide best hardwares, and can maintain multiple servers for distributing database, Inout Spider can be used for world wide search as well.
Scalable (*NEW*): Inout Spider is a scalable spider software. You may start with just one server and later can scale to multiple servers, as your database grows. We are using highly efficient and powerful distributed file system(Hadoop) and database(Hypertable) for providing scalability feature. It helps you to start small and dynamically expand to any number of servers.
Based on Hadoop and Hypertable (*NEW*): As we mentioned earlier, Inout Spider is powered by the latest technology developments like Hadoop and Hypertable. Hadoop is a high performance distributed file system, currently supported by Apache. Hypertable is scalable, non-relational database works on top of Hadoop which can handle Terra-bytes of data without affecting the performance. Hypertable works very similar to Google's BigTable (Google's Own Database, which is the core DB of all Google services).
Note:
Hypertable - An Open Source,High Performance,Scalable Database - is High performance C++ implementation of Google's Bigtable. It is a large scalable, linear and fast database, which is very much similar to Hbase by structure vise, so that you can understand the peculiarities of this database by seeing the slideshow . More over, the hypertable is more faster than Hbase. Also you can visit http://nosql-database.org/ and http://hypertable.org/ to understand more about hypertable database and its peculiarities. Since hypertable support distributed structure, it will be very helpful in gradual expansion of the system.
XML Search Output: Inout Spider provides search results as XML instead of HTML results. It gives you great flexibility over the results. You may parse these XML results using your own PHP/ASP/.NET/JSP program. Also Inout Search Engine work seamlessly with Inout Spider to expose all the features/capabilities of this, by just configuring the Spider install path in Inout search engine admin area. If you want to write your own program instead of using Inout Search Engine, we are providing a free XML parser documentation to describe the Spider XML output.
Web Search: Inout Spider web search always find the best matched results available in your database for the given keywords. Right now, Inout Spider can handle Web, Image(Beta) and News searches. Our team is working on Video search as well and is likely to be added to the package within a couple of months.
Image Search: Inout Spider is one of the rarer spider softwares available on the net which provides image search. Inout Spider's crawler will crawl images from the added domains while crawling the HTML pages and it tags various keywords and other parameters related to the images. The spider saves a thumbshot of the image in the database. The dimensions of the thumbshots can be configured by the administrator.
News Search (Beta): News search is another type of search which works like web search, but here the results are taken only from the domains which are added as news domains. The data corresponding to these news domains are updated frequently so that the most updated contents will be displayed as the results of news search.
Unlimited Custom Result Channel: Apart from web, image and news results, you may create a number of search channels like Script Search, Soccer Search, Wikipedia Search etc, with the help of domainsets and categories which are explained below.
Domain Sets: Inout Spider allows you to define a domain set in your spider admin area. Each page the Spider Bots crawl, will be verified against the domain sets, and if its finds a match, it will tag the page to the corresponding domain set. You may later filter/retrieve your web/image/news results based on a domain set. It will help you to create a service(with a group of websites) specific search channel.
Categories: Similar to domain sets, Inout Spider allows you to define categories from the admin area. You may define the keywords related to a category so that if the Spider bot finds a match with the keyword, it will tag the page to the corresponding category. You may later filter your web/image/news results based on the categories to create your desired channel.
Intelligent Result Indentifier System (*NEW*):Upon a user query, the result identifier finds out the best matched results from millions of pages. Since this Result Identifier System works very fast, it will fetch the required results as output in an excellent way only by taking milli seconds of time. At the same time, this system will not compromise with the high level of quality and accuracy of the output expected in any way
Family Filter: Inout Spider allows you to configure family filter setting from your admin area to perform screening. Family filter is easy to manage and it will help you to retrieve results based on the family filter condition you want.
Page Rank: Inout Spider determines a page rank for each page it crawls based on many factors like incoming/outgoing links, page depth, domain priority etc.
API Keys: API keys protect your spider data from unauthorized access. It also helps you to authorize/sell search data access to external parties. You may also view the statistics based on API keys which helps you to track the search history and performance from each API key.
Result Caching: Upon a search query, the Query Analyser[Please see the tutorial] module of Inout Spider will check the database for a result cache. If it finds a result there, it will immediately get the results back to the requester. If a pre-calculated recent result is not available already, 'result generator' will quickly identify and generate the results from the pages crawled, store in cache database, and send back to the requester. Result caching will help you to get instant search results for popular keywords.
Cache Period: Although the result cache feature helps to get faster results, we cannot always fetch results from cache, considering the chance to get the results outdated. Considering this, different cache periods can be set up, default 1 day for news, 7 days for web and 45 days for images. It will make sure that the results delivered to the clients are always updated frequently as the time interval expires.
Advanced Crawler Controls (*NEW*):The advanced crawler control helps you to get desired result quality with limited resources. It gives you a complete control on domains and the crawling process will be based on some predefined configuration settings.
Global/Individual Domain Depth Control (*NEW*):Inout Spider helps you to control the crawling process specifying the domain page depth limit. You may specify the settings globally for all domains or specifically for some selected domains. It will help you to make sure that the spider resources are utilized the way you want it to be
Global/Individual Domain Pages Control: Inout Spider can be configured to crawl only a limited number of pages from a particular domain name. Similar to depth control, it helps you to control the crawling process. You may specify the settings globally or individually for selected domains.
Managed/Automated Crawling: Inout Spider allows you to run your script on different crawling mods. You may specify whether you want to let the crawler manage finding and managing new domains or the administrator need to approve the domains first before crawling.
Global/Individual Control for Automated Crawling: Inout Spider lets you configure the controlled/uncontrolled domain identification and fetching globally or for selected domains. It will help you to have more specific control on the spider and to acquire the desired result quality.
Keyword Identification/Retrieval (*NEW*): Inout Spider identifies the meta tags and related keywords of each page while crawling. Upon a user query, these top keywords can be retrieved along with each result. It helps you to find out keyword tags, related keywords etc.
Search Logs: Inout Spider tracks each and every search query request it receive, with all parameters related to the query. It also tracks the API key associated with each query. It helps you to track all the statistical details related to the search queries.
Statistics: This helps you to know your entire spider status. It will show you the Total Domains Count, Total Pages count, Total Crawled pages count etc.
Click here to see what our clients say about Inout Spider.
Access Components of Inout Spider
Public Area [Where the people can submit their domains]
Admin Area [Where Administrator can manage the settings]
XML Area [Where your program can query for search results]
Crawler Area [Area accessed by cron job]
Inout Spider Process:
The following case study will help you to expose the true power of the advanced settings
Case Study - QueryScripts.com
Queryscripts.com is a dedicated search engine to search web scripts. It targets only webmasters who would like to purchase free/commercial web scripts for their websites. To make a search engine for the purpose, what we have done is, we added popular script directory websites like hotscripts.com, scripts.com, scriptcopy.com, condango.com etc directly from the admin area. Then we configured the spider to crawl all the pages of the above domains without any limit and to automatically add and approve all the new domains it find in the above websites. Then we kept the global settings to crawl only 100 pages from a domain and not to add new domains to the database the spider finds while crawling. So while keeping the crawling limit globally, then main 5 domains overrides those limitations.
As a result, the spider crawls all the pages of the main websites, and crawls 100 pages from each new domain it find in the main websites. It will make sure the crawler is maintained automatically and turned to get results only specific to web script industry.
Inout Spider General Features
One of the most powerful web spider softwares available on the net.
Optimal for highly scalability search engines (*NEW*)
You can use as your ultimate search data source for your portal/search engine.
Script fully based on PHP, MySQL and Hypertable (*NEW*)
Work seamlessly with Inout Search engine to expose all of its features/capabilities.
Provide easy integration with your own search engine (with the help of a free XML parser documentation).
Capable enough to deal with huge amount of data and concurrent queries (*NEW*)
Distributed and expandable data structure for expanding to multiple servers as the growth of the system (*NEW*)
Very good performance even under heavy traffic and huge amount of data (*NEW*)
Quick search response time due to the advanced database clustering mechanism (*NEW*)
Dedicated query analyzer module for responding very quickly towards the user queries.
An intelligent Result Generator module for preparing outputs in the required XML format.
An inbuilt spider bot module for crawling new pages and identifying links, keywords etc.
Providing a separate package for Inout Bot besides Inout Spider package for reducing the overload of the master server, thus helps in faster crawling.
Works Good on a reliable VPS Hosting Environments (*NEW*)
You can handle Web, Image and News(Beta) searches very efficiently.
Supports to create a number of search channels like Script Search, Soccer Search, Wikipedia Search etc.
Domain Set(a group of websites or domains) to create a service specific search channel.
Categories to create category based search channel(Sports, Politics etc).
You may add or manage domains directly from the admin area.
Allows users to submit their domain names for crawling.
Capable to identify new domains during the crawling process.
Treating news domains separately which enables frequently crawling from such domains.
You can specify the size and width of thumbshots for image results.
You may view the top queued pages from your admin panel, which help you to understand the current status of the pages in database.
You can view the list of identified keywords from different keyword clusters.
You can view the keyword logs along with the constraints.
You can limit page search by depth also.
You can restrict a particular domain even after a number of crawling (*NEW*)
You can prevent showing of already crawled results from the restricted or deleted domains (*NEW*)
You can search whether a particular domain is already included or not.
Identifying the meta tags and related keywords of each page while crawling which helps in identifying keyword tags, related keywords etc.
You can set meta keyword limit from pages while crawling upto a particular number.
XML Search Output which ensures great flexibility to users.
Universal and Optional Arguments for Web, Images and News.
May parse these XML results using your own PHP/ASP/.NET/JSP program.
Filtering based on domain sets to obtain search results from a predefined set of domains.
Filtering based on categories to obtain search results under a specified category.
Filtering by specifying the required file types as external parameters (pdf, txt etc).
Intelligent Result Identifier System.
Multi-language Search (Beta).
Multi Country Support (Beta).
Family filter setting to perform screening on results.
Page Rank based on incoming/outgoing links, page depth, domain priority etc (*NEW*)
Page priorities based on page rank.
Excellent page ranking methods (*NEW*)
Provides any number of API keys to protect your spider data from unauthorized access (*NEW*)
You can use API keys to authorize/sell search data access to external parties.
You can track and control the usage of data from spider under each API keys easily.
You can track each and every search query request it receive, with all parameters related to the query.
Result Caching to get instant search results for already searched keywords.
Automatically removes the old cache results to ensure that the results are always fresh.
Configuration settings with different options which helps to acquire the desired result quality.
Faster crawling mechanism for adding newly identified domains,pages and page contents (*NEW*)
Advanced Crawler Control tools which give a complete control on domains added.
Global/Individual Domain Depth Control to limit the depth at which the spider goes for a domain.
Global/Individual Domain Pages Control (a limited number of pages from a particular domain name).
Managed/Automated Crawling.
Global/Individual domain addition control for automated crawling (*NEW*)
Key Admin Features
Add/manage/delete domains.
Specify news domains to faster crawling.
Restrict domains even after start crawling.
Delete already crawled results of the restricted domains.
Search for domains.
View the queued pages and crawled pages.
View the list of all identified keywords from each pages.
View the query keywords along with the number of total results.
Set the number of pages to be crawled by the bot for a single execution.
Limit page search by depth.
Set meta keyword limit from pages while crawling up to a particular number.
Specify the size and width of thumbshots for image results.
Create domain sets(a group of websites or domains) to create a service specific search channel.
Manage/delete domain sets.
Create categories for a theme based search channel(Sports, Cricket etc).
Manage/delete categories.
Track each and every search query request it receive as search logs, with all parameters related to the query.
Create any number of API keys.
Use API keys to authorize/sell search data access to external parties.
Track and control the usage of data from spider under each API keys easily.
View the statistics of different searches based on API keys.
Track the search history and evaluate performance from each API key.
Manage Family Filter to perform screening on results.
Add/manage/delete countries and languages.
Statistics including page queue details, crawled pages details etc
Other important features
Easy installation
Developed on MVC framework
Search Engine Friendly URL
Quick tutorial
100% template driven and fully customizable
Easy advertising, integrating your google adsense and other affiliate banner/text ads
InoutScripts provides a complete mailing
list solution with the Inout Mailing List Manager. It is a low cost,
feature rich solution for your mailing list requirements. Inout Search
Engine provides a complete search engine solution whatever be your searching
requirements. Please read the terms of use before buying scripts. Our
Partners : QuerySpace,
XZeroScripts,
Scripts.com, ScriptSearch.com
| Support Desk Forums(New) • Careers • Suggestions • Contact
