How to solve pg_tblspc problem in postgres

This blog will talk about How to solve pg_tblspc problem in postgres

pg_tblspc problem postgres

Sometime when we are doing some operation on Postgres database, we faced this error.

I faced  it,  when I  was  trying  to  get  values  from  database.

This issue throws error that could not open directory “pg_tblspc/<1234…x>”: No such file or directory

To  solve this  issue  you  first  have  to  create  dump  of  your  database. Steps are ahead …

 

  • psql -h localhost -p 6666 -U postgres -d <yourDBname>-f “E:/xyz/abc.p”

(It will create dump file of your database)

  • Then delete your old database after dumping it.

(dump database <yourDBname>)

  • Then again restore it from your dump file…

 

Or, Its better to use your backup file while restoring..

If  problem  is  still  there then we need  to first restore that <abc.p/abc.sql> file  on  our  local  machine

  • then  again  create  (.p)  file  as  dump  file
  • And restore your postgres by using this new dump file…

You will not come across this problem again……..

 

Another way:-

1) Backup data with pg_dump

 

pg_dump -i -h localhost -p 5432 -U postgres -F c -b -v -f

“/usr/local/backup/10.70.0.61.backup” old_db

 

To list all of the available options of pg_dump, please issue following command.

 

  • Ø pg_dump -?

 

-p, –port=PORT database server port number

-i, –ignore-version proceed even when server version mismatches

-h, –host=HOSTNAME database server host or socket directory

-U, –username=NAME connect as specified database user

-W, –password force password prompt (should happen automatically)

-d, –dbname=NAME connect to database name

-v, –verbose verbose mode

-F, –format=c|t|p output file format (custom, tar, plain text)

-c, –clean clean (drop) schema prior to create

-b, –blobs include large objects in dump

-v, –verbose verbose mode

-f, –file=FILENAME output file name

 

2) Restore data with pg_restore

 

pg_restore -i -h localhost -p 5432 -U postgres -d old_db -v

“/usr/local/backup/10.70.0.61.backup”

 

To list all of the available options of pg_restore, please issue following command.

 

  • Ø pg_restore -?

 

-p, –port=PORT database server port number

-i, –ignore-version proceed even when server version mismatches

-h, –host=HOSTNAME database server host or socket directory

-U, –username=NAME connect as specified database user

-W, –password force password prompt (should happen automatically)

-d, –dbname=NAME connect to database name

-v, –verbose verbose mode

 

Pushpraj Kumar,

Helical IT Solutions

Tech Tips in Penaho Server – publishing password setting for server – Disable the folder names in Browser panel in the Server

Hi guys..

The below tips are very useful in Pentaho Server for BI developers.
1) publishing password setting for server
You need to publish the reports or schema(s)[developed in PSW] once you done with developing. For this you need set the publishing password for Pentaho server.
Go to this location 
<location of Pentaho>biserver-ce-4.8.0-stablebiserver-cepentaho-solutionssystempublisher-config.xml and edit the “publisher-config.xml”  file.

Give your publish password b/w  these tags  <publisher-password> </publisher-password>

Example:
<publisher-password>password</publisher-password>    ( password can be any name that you wish to give)

Snapshot is a worth more than text. find the image below.

Save the file. stop the server and start the server.

2) Disable the folder names in Browser panel of Pentaho Server
* What ever the folder you create in Browser panel of pentaho server, it directly stores   under pentaho-soulutions
i.,e in this location
<Pentaho location>Pentahobiserver-ce-4.8.0-stablebiserver-cepentaho-solutions
* You can disable all of your folders that comes with installation & the later created ones  which you don’t want to appear in the browser panel.
*   Inside every folder(pentaho default or the folders created by you) you can find “index.xml” file. You need to edit this file. You need to change visable tag as “false”.
Find the sanpshot.

You need not restart the server. Just you need to refresh the browser panel in the server.
You can observer the invisibility of the folder.

Sadakar Pochampalli.

 

 

Helical IT Solutions (an Open source DWBI company providing services on Jaspersoft, Pentaho, Talend, Kettle, Data visualization) covered by a growing magazine.. Business for All

Helical Covered by Biz for All Magazine

Helical Covered by Biz for All Magazine

 

 

Among the many Information Technology startups, Helical IT Solutions, a Hyderabad based technology company providing services in open source data warehousing and business intelligence services, has been moving up the ladder with incredible pace and bagged a seed funding of INR 2.5 million from the Singapore based Citibank within six months of starting operations.

 

The company which started in Nov. 2012 has catered to the technology needs of clients in various domains including e-commerce, insurance, energy, social media analytics, healthcare and human resource while building and managing their Business Intelligence (BI) platforms.

 

The eight member strong team in Helical is quite excited with the fund inflow and plans to use it primarily for recruitment and partnering with leading BI vendors in the open source space such as Jaspersoft and Pentaho. “We want to focus and build up our capability of providing sector specific BI offering with this fund,” one of founders Nikhilesh Tiwari said. Specializing in Open source technologies, Helical has proved to be a great bet for its clients cutting down on their costs and adding to their efficiency and turnover. Their services include BI, ETL, Data warehousing and data modelling, data visualization to name a few. Helical IT Solutions is an open source Data warehousing and BI company based out of Hyderabad. The company works primarily on Jaspersoft and Pentaho BI suite and on talend, on Talend and Kettle. According to Gartner’s 2012 CIO survey, analytics and BI is the No. 1 technology priority for CIOs in 2012.

 

 

BI, analytics and PM software market was the second-fastest growing sector in the overall worldwide enterprise software market in 2011. “India is growing faster than any other country in BI sector in Asia Pacific with 36 per cent growth rate and the market for BI software in India is forecast to reach revenue of $81.5 million in 2012,” he said. Every 15 seconds, an open source BI s/w is downloaded and around 80 per cent of them need consultation and services as to how use them. With the angel investment, plans are underway to expand the team and hiring, develop infrastructure, SI partnership with Jaspersoft & Pentaho to get projects from even bigger clients and at a higher margin. “Building a parallel team after some time and start working towards building a product (we have energy domain, ecommerce domain primarily in mind),” he said about future plans. It is not that the company had walked a rosy path as due to lack of resources, they had to turn down many clients like Jabong.com, Mangaquest, Inspire edge IT solutions,  XiBoss.

Helical IT Solutions Raises Funding

Hyderabad, May 6, 2013: Of the many IT start-up success stories there is a new one on the block to watch out for. Helical IT Solutions, a Hyderabad based technology company providing services in open source data warehousing and business intelligence services has bagged a seed funding of INR 2.5 million from Singapore based Citibank official within 6 months of starting operations.

The company which started in November 2012 from Hyderabad has catered to technology needs of clients in various domains including e-commerce, insurance, energy, social media analytics, healthcare and human resource while building and managing their Business Intelligence platforms.

The eight member strong team is quite excited with the fund inflow and plans to use it primarily for recruitment and partnering with leading BI vendors in the open source space such as Jaspersoft and Pentaho. They want to focus and build up their capability of providing sector specific BI offering with this fund.

Specializing in Open source technologies, Helical has proved to be a great bet for its clients cutting down on their costs and adding to their efficiency and turnover. Their services include Business Intelligence, ETL, Data warehousing and data modelling, data visualization to name a few.

About Helical IT Solutions :
Helical IT Solutions is an open source Data warehousing and Business Intelligence company based out of Hyderabad. The company works primarily on Jaspersoft and Pentaho BI suite and on talend, on Talend and Kettle. Other services provided are data visualization, data modelling, data warehousing etc.

Contact Person :
Nikhilesh Tiwari
Cell : +91-7893947676
Email : [email protected]

The companies funding news has been covered y many leading India based websites

http://www.watblog.com/2013/05/07/business-intelligence-startup-helical-it-raises-seed-funding/

http://www.vccircle.com/news/technology/2013/05/07/tech-startup-helical-raises-angel-funding-singapore-based-investor

http://www.iamwire.com/2013/05/data-warehousing-firm-helical-it-solutions-raises-angel-funding/

http://startupcentral.in/2013/05/helical-raises-seed-funding-from-spore-investor-22708/

http://www.dealcurry.com/2013057-Helical-IT-Solutions-Raises-Angel-Investment.htm

http://yourstory.in/2013/05/open-source-dwbi-company-helical-it-solutions-raises-angel-investment-worth-inr-2-5-million/

http://infotechlead.com/2013/05/07/helical-it-solutions-secures-inr-2-5-million-angel-funding/

http://www.nextbigwhat.com/helical-technology-solutions-funding-297/

http://www.dealcurry.com/2013057-Helical-IT-Solutions-Raises-Angel-Investment.htm

http://www.siliconindia.com/news/startups/Helical-IT-Solutions-raises-Rs25-million-In-Angel-Investment–nid-146582-cid-100.html

http://startupcentral.in/2013/05/helical-raises-seed-funding-from-spore-investor-22708/

How is BI driving Data Decisions

In today’s world, companies use various software like ERP, HRM, CRM, Tally, Salesforce, Web services, etc. There are different databases like MySQL, Oracle, DB2, Ingres, Postgres, MongoDB and the list goes on. Data generation is rapidly growing with collation of personal data, financial data, sales data, business data, accounting data, so on and so forth. Though, there are different software and databases, but the missing element at this point is an insight on the information.

There is a need for centralized location, where one can login and view current news and updates. This location will be like a storehouse of information, collated from various location and data. For a profitable business establishment, numerous parameters and accurate information are required by the managers to achieve the right decision for the growth of an organization. At this point, business intelligence plays a pivotal role in providing accuracy in information and views to profitable paths.

Business Intelligence (BI) refers to technologies, applications, and practices for collection, integration, analysis, and presentation of business information. The purpose of BI is to support and improve business decision-making. A proper BI system helps with right information, at the right time, in the right format.

A single BI could help all the departments like:
1. Marketing Department – Helps in growing its top-line with features like analyzing campaign returns, promotional yields, and provide solutions to expenditure for profitable ROI, and tracking social media marketing
2. Sales – Finding the best path and practices, customer acquisition cost, and improvement in yearly turnover and sales
3. Inventory – Monitoring and adjusting inventory levels
4. Human Resource – Tracking and managing employee turnover, attrition rate, recruitment process, etc.

Correct usage of BI has shown excellent results in all the sectors, be it healthcare, e-commerce, NGO, government, media domain, etc.
– On an average, ROI is $10.66 for every $1 spent on business analytics
– Moneyball movie guided by BI was nominated for the best picture
– FEBREZE marketing campaign was aided by BI, sales now hit over $1 bn annually
– Correct usage of BI can help in reducing OPEX by up to 50%
– FT used high-end BI functionality to see a growth of 20%
– The US government uses BI to assign tasks to the police personnel

Main Elements of BI are
There are many parameters on which BI tool are tested before selection

– Interactivity :- The various reports and dashboards should have high level of interactivity. Let say, if a person is viewing the total sales report, the report should be interactive and navigable so that one can drill down to view specifications like product sales, time period, etc.

– Data Visualization :- It is important to have an accurate format for data visualization. For example, month on month sales would be represented in the form of line graph, component wise contribution would be displayed in the form of pie diagram, etc. In case, the data is not represented in accurate format, drawing conclusion on the basis of unorganized format will lead to open ending decisions. Any BI tool should have really good data charting engines integrated with it.

– Connection to databases :- As explained earlier, BI tool has the ability to fetch information by connecting to different databases and webservices so that the right information is provided to the stakeholders. This can be implemented by the right ETL tools which are an additional part of BI tool.

– Mobile BI :- Increase of mobility among the workforce, is raising demands to create a space for information on mobile phones, tablets, and other such devices. Hence, the reports, dashboards, mashups, etc are being rendered to compatible with on the go devices.

– Ad-hoc Reporting :- Usually the requirements of a business user and an IT person differs on a large scale. This elongates the development cycle which creates a requirement for ad-hoc reporting. It helps the end users to drag, drop, and configure their own set of reports, visualization, and analysis as per their requirements from the dashboard.

– Application Integration :- BI tool is an easy integrable device, which is compatible with existing application/portal/software irrespective of its developed software of PHP, Java, Ruby, C or any other platform.

– Predictive Analytics :- By using high-end algorithms and using historical data, predictions can be made like propensity of a customer purchase and his return, machine failure, sales expected, revenue expected, region wise sales, etc. With this system adaptation, a company is set to be more proactive.

Apart from the above mentioned, there are other factors like speed, in-memory analytics, cloud BI, and security to name a few.

BI is an essential tool for companies to take concrete measures in their growth and decision-making aspects.  According to a survey, if a decision is made relying on data rather than pure intuition, the chances of succeeding are 79% higher. BI gives companies a more structured way to look at data while providing deep interpretations. It aids decision-making via real-time, interactive access to and analysis of important corporate information.

BI tools bridge the gaps between information silos of an organization. A company, which is not driven by metrics, might not be able to understand the problematic areas, whereas a company with BI has the capacity to access industry information and insight to the problem, and based on the data, a plan can be worked towards improving its business processes.

(Article taken from my original article published on Dataquest magazine – http://www.dqindia.com/dataquest/column/186915/how-bi-driving-data-decisions/page/1)

Jaspersoft V/s Pentaho – Which one to use & Is there any need to purchase Commercial Edition?

Jaspersoft V/s Pentaho – Which one to use & Is there any need to purchase Commercial Edition?

Any company (be it technology, manfucaturing, human resource, ecommerce, SME etc) always has the need for Business Intelligence to some or the other extent. If cost is one of the consideration factor, then the 2 BI tools which are at the forefront are Pentaho and Jaspersoft. But, often the same companies are caught up in an imbrogilo as to which tool to use, what are the technology/and end business user wise differences/ do i actually need to purchase commercial edition, is there any work around etc.

Differences :- In the below mentioned points, I have tried to cover functionality wise the differences

a. Reports :- Jaspersoft is known for its picture pixel perfect reporting. Jasper uses ireport for designing the reports. Hence, for having reports, Jaspersoft is the most ideal candidate. Pentaho uses Pentaho Report Designer.

b. Dashboards :- Pentaho provides much more capabililties, interactivity in terms of dashboards. Dashboards designed in Pentaho are far more superior in functionality, aesthetically as compared to Jaspersoft. Pentaho CE uses CDE/CDF, Pentaho EE uses PDD . Dashboard functionality is present only in the Enterprise edition of Jaspersoft.

c. Pentaho is having an intermediate layer known as Xactions & hence providing much more flexibility in terms of plugin designing, integration with applications, having out of box experience etc. Xactions supports scripting and scheduling of scripts execution. Jaspersoft dosent provide that much of flexibility in terms of intermediate layer, but never-the-less, Jasper server by default comes with some functionalities like scheduling, for plugin desiging they rely on ireport plugins and Jasper server plugins,

e. Mobile BI compatibility :- Jaspersoft scores higher than Pentaho here. They have BI for iOS, Android platforms. Functionality wise and user interface wise Jaspersoft mobile BI is better. They even have an opensouce Apple iphone application. Pentaho users have to often rely on third party tools to enhance mobile BI experience. But, Jasper provides native mobile API hence helping developers to create mobile applications. Pentaho mobile BI is only present in the enterprise edition.

f. Documentation : Jaspersoft invests a lot of time in documentation. Its pretty evident from that fact that they are having different case studies of the different clients on their website, explaining how Jaspersoft has helped them.

g. ETL : Jaspersoft uses Talend and Pentaho uses Pentaho Data Integrator (Kettle) as their default ETL tools. Kettle is developed by Pentaho organization itself unlike the case of Jaspersoft which uses Talend Open Studio version with some functionalities missing.

h. OLAP Analysis : Both Jaspersoft and Pentaho uses Pentaho Mondrian engine in their BI suite, and it goes unsaid which one will be stronger in this case.

i. Community support : Community support is more in Jaspersoft as compared to Pentaho. Also, the community members are more active of Jaspersoft community, hence if you are using CE, the chances of problem resolution is much more.

j. Plugin : Pentaho is having many plugin which are ready to use like CDE, CDF, Saiku etc. Pentaho is having a highly active community for plugin designing. Pentaho server by default comes with marketplace (just like appstore). Jaspersoft is a late entrant in this field and is currently having very limited plugins till now. They have also started Jasperexchange for their plugins.

k. Data Mining : Pentaho is having data mining module named Weka and Jaspesoft uses R. Again Weka is developed by Pentaho itself unlike the case with R. But toolwise, R is more advanced and more capable as compared to Weka

l. Big Data : Both Jaspersoft and Pentaho provides big data integration services.

m. Unlike Jaspesoft, Pentaho provides a much more tightly integrated BI suite since it has itself developed most of the components.

n. Jaspersoft EE has fusionchart integration. The latest version of Jaspesoft 5.0 EE is having Highcharts integration with it. Pentaho has open flashcharts integration. For geographical charting, Jaspersoft is having mapbox pro whereas Pentaho is having google maps.

o. Summarizing Jasper has a heavy focus on reporting and analysis. It has a better web 2.0 user interface than Pentaho and is generally easier to use. It benefits from better marketing, informational web sites, and documentation. Overall, it makes researching and finding what users need easier than Pentaho. Whereas Pentaho focuses on data integration, ETL, and workflow automation. It has a user interface that is more difficult for business users than is Jasper’s. The

documentation is also less robust than its competition. On the other hand, it has

strong data mining tools, ETL, flexibility via Xactions.

Which BI tools is to be used, whether enterprise edition has to be purchased or is there any other way out (like best of breed solution of different BI suites, plugin development, data visulization charting engines integration etc) – all these things can only be ascertained by a thorough discussion between the company and the solution provider. Its generally ideal to go and have a consultation with a company having exp in different BI technologies which will be able to give a comprehensive picture and can help the client towards business objective, rather than trying to push their software. Please get in touch with us for Jaspersoft, Pentaho, Data warehousing, ETL or any other DWBI related requirement – [email protected]