Merge Table: Too many open files

[Nils]

Hello,

my problem:

I merged about 1.000 Tables with

Create table name (variables) type=merge
union=(table1,t able2,...,table 1000);

MySQL now creates a tables, but I can't open it. Everytime I get the
message: Error 24. Which means: 'Too many open files'.

I tried to tune the server by setting the variable for
open_files_limi t to 10.000. But still the same problem.

Can anybody help me?

Thanks,

Nils

[Benoit St-Jean]

Re: Merge Table: Too many open files

kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=blue]
> Hello,
>
> my problem:
>
> I merged about 1.000 Tables with
>
> Create table name (variables) type=merge
> union=(table1,t able2,...,table 1000);
>
> MySQL now creates a tables, but I can't open it. Everytime I get the
> message: Error 24. Which means: 'Too many open files'.
>
> I tried to tune the server by setting the variable for
> open_files_limi t to 10.000. But still the same problem.
>
> Can anybody help me?[/color]

Well, I don't think your problem is related to file handles...
Merging 1000 tables is usually a sign of a design problem. Can you
explain why you need to merge that many tables???

[Benoit St-Jean]

Re: Merge Table: Too many open files

kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=blue]
> Hello,
>
> my problem:
>
> I merged about 1.000 Tables with
>
> Create table name (variables) type=merge
> union=(table1,t able2,...,table 1000);
>
> MySQL now creates a tables, but I can't open it. Everytime I get the
> message: Error 24. Which means: 'Too many open files'.
>
> I tried to tune the server by setting the variable for
> open_files_limi t to 10.000. But still the same problem.
>
> Can anybody help me?[/color]

Well, I don't think your problem is related to file handles...
Merging 1000 tables is usually a sign of a design problem. Can you
explain why you need to merge that many tables???

[Nils]

Re: Merge Table: Too many open files

bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=blue]
> kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=green]
> > Hello,
> >
> > my problem:
> >
> > I merged about 1.000 Tables with
> >
> > Create table name (variables) type=merge
> > union=(table1,t able2,...,table 1000);
> >
> > MySQL now creates a tables, but I can't open it. Everytime I get the
> > message: Error 24. Which means: 'Too many open files'.
> >
> > I tried to tune the server by setting the variable for
> > open_files_limi t to 10.000. But still the same problem.
> >
> > Can anybody help me?[/color]
>
> Well, I don't think your problem is related to file handles...
> Merging 1000 tables is usually a sign of a design problem. Can you
> explain why you need to merge that many tables???[/color]


Because I have so many points. (Simple description *g*)

I have to deal with geographical points (x,y,z). They are stored in a
point table. For each point table I made a table with metainformation .
For an overwiev I want to join these metainformation .

Sure, I can put all metainformation in one table. But I want to have
each measurement in a separat table.

It has worked with about 1 Billion points from about 400 measurements.

Now I have less points but more measurements. About 1000. And I tried
the same architecture.

[Nils]

Re: Merge Table: Too many open files

bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=blue]
> kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=green]
> > Hello,
> >
> > my problem:
> >
> > I merged about 1.000 Tables with
> >
> > Create table name (variables) type=merge
> > union=(table1,t able2,...,table 1000);
> >
> > MySQL now creates a tables, but I can't open it. Everytime I get the
> > message: Error 24. Which means: 'Too many open files'.
> >
> > I tried to tune the server by setting the variable for
> > open_files_limi t to 10.000. But still the same problem.
> >
> > Can anybody help me?[/color]
>
> Well, I don't think your problem is related to file handles...
> Merging 1000 tables is usually a sign of a design problem. Can you
> explain why you need to merge that many tables???[/color]


Because I have so many points. (Simple description *g*)

I have to deal with geographical points (x,y,z). They are stored in a
point table. For each point table I made a table with metainformation .
For an overwiev I want to join these metainformation .

Sure, I can put all metainformation in one table. But I want to have
each measurement in a separat table.

It has worked with about 1 Billion points from about 400 measurements.

Now I have less points but more measurements. About 1000. And I tried
the same architecture.

[Benoit St-Jean]

Re: Merge Table: Too many open files

kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311120334.26f1 56e9@posting.go ogle.com>...[color=blue]
> bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=green]
> > kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=darkred]
> > > Hello,
> > >
> > > my problem:
> > >
> > > I merged about 1.000 Tables with
> > >
> > > Create table name (variables) type=merge
> > > union=(table1,t able2,...,table 1000);
> > >
> > > MySQL now creates a tables, but I can't open it. Everytime I get the
> > > message: Error 24. Which means: 'Too many open files'.
> > >
> > > I tried to tune the server by setting the variable for
> > > open_files_limi t to 10.000. But still the same problem.
> > >
> > > Can anybody help me?[/color]
> >
> > Well, I don't think your problem is related to file handles...
> > Merging 1000 tables is usually a sign of a design problem. Can you
> > explain why you need to merge that many tables???[/color]
>
>
> Because I have so many points. (Simple description *g*)
>
> I have to deal with geographical points (x,y,z). They are stored in a
> point table. For each point table I made a table with metainformation .
> For an overwiev I want to join these metainformation .
>
> Sure, I can put all metainformation in one table. But I want to have
> each measurement in a separat table.
>
> It has worked with about 1 Billion points from about 400 measurements.
>
> Now I have less points but more measurements. About 1000. And I tried
> the same architecture.[/color]

Well, have a look at :

http://www.mysql.com/doc/en/MERGE.html

Especially read the section on MERGE table disadvantages, it talks
about file handles...

I'd say try to change your design...

[Benoit St-Jean]

Re: Merge Table: Too many open files

kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311120334.26f1 56e9@posting.go ogle.com>...[color=blue]
> bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=green]
> > kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...[color=darkred]
> > > Hello,
> > >
> > > my problem:
> > >
> > > I merged about 1.000 Tables with
> > >
> > > Create table name (variables) type=merge
> > > union=(table1,t able2,...,table 1000);
> > >
> > > MySQL now creates a tables, but I can't open it. Everytime I get the
> > > message: Error 24. Which means: 'Too many open files'.
> > >
> > > I tried to tune the server by setting the variable for
> > > open_files_limi t to 10.000. But still the same problem.
> > >
> > > Can anybody help me?[/color]
> >
> > Well, I don't think your problem is related to file handles...
> > Merging 1000 tables is usually a sign of a design problem. Can you
> > explain why you need to merge that many tables???[/color]
>
>
> Because I have so many points. (Simple description *g*)
>
> I have to deal with geographical points (x,y,z). They are stored in a
> point table. For each point table I made a table with metainformation .
> For an overwiev I want to join these metainformation .
>
> Sure, I can put all metainformation in one table. But I want to have
> each measurement in a separat table.
>
> It has worked with about 1 Billion points from about 400 measurements.
>
> Now I have less points but more measurements. About 1000. And I tried
> the same architecture.[/color]

Well, have a look at :

http://www.mysql.com/doc/en/MERGE.html

Especially read the section on MERGE table disadvantages, it talks
about file handles...

I'd say try to change your design...

[Nils]

Re: Merge Table: Too many open files

bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311120627.1047 ffcf@posting.go ogle.com>...[color=blue]
> kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311120334.26f1 56e9@posting.go ogle.com>...[color=green]
> > bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=darkred]
> > > kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...
> > > > Hello,
> > > >
> > > > my problem:
> > > >
> > > > I merged about 1.000 Tables with
> > > >
> > > > Create table name (variables) type=merge
> > > > union=(table1,t able2,...,table 1000);
> > > >
> > > > MySQL now creates a tables, but I can't open it. Everytime I get the
> > > > message: Error 24. Which means: 'Too many open files'.
> > > >
> > > > I tried to tune the server by setting the variable for
> > > > open_files_limi t to 10.000. But still the same problem.
> > > >
> > > > Can anybody help me?
> > >
> > > Well, I don't think your problem is related to file handles...
> > > Merging 1000 tables is usually a sign of a design problem. Can you
> > > explain why you need to merge that many tables???[/color]
> >
> >
> > Because I have so many points. (Simple description *g*)
> >
> > I have to deal with geographical points (x,y,z). They are stored in a
> > point table. For each point table I made a table with metainformation .
> > For an overwiev I want to join these metainformation .
> >
> > Sure, I can put all metainformation in one table. But I want to have
> > each measurement in a separat table.
> >
> > It has worked with about 1 Billion points from about 400 measurements.
> >
> > Now I have less points but more measurements. About 1000. And I tried
> > the same architecture.[/color]
>
> Well, have a look at :
> http://www.mysql.com/doc/en/MERGE.html
>
> Especially read the section on MERGE table disadvantages, it talks
> about file handles...
>
> I'd say try to change your design...[/color]

I think you are right. OK, another weekend work. *g*
Thanks.

[Nils]

Re: Merge Table: Too many open files

bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311120627.1047 ffcf@posting.go ogle.com>...[color=blue]
> kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311120334.26f1 56e9@posting.go ogle.com>...[color=green]
> > bstjean@yahoo.c om (Benoit St-Jean) wrote in message news:<3540ac3e. 0311111034.1dd0 aadf@posting.go ogle.com>...[color=darkred]
> > > kroenert@smilec onsult.de (Nils) wrote in message news:<2133dbc1. 0311110743.1af0 cdde@posting.go ogle.com>...
> > > > Hello,
> > > >
> > > > my problem:
> > > >
> > > > I merged about 1.000 Tables with
> > > >
> > > > Create table name (variables) type=merge
> > > > union=(table1,t able2,...,table 1000);
> > > >
> > > > MySQL now creates a tables, but I can't open it. Everytime I get the
> > > > message: Error 24. Which means: 'Too many open files'.
> > > >
> > > > I tried to tune the server by setting the variable for
> > > > open_files_limi t to 10.000. But still the same problem.
> > > >
> > > > Can anybody help me?
> > >
> > > Well, I don't think your problem is related to file handles...
> > > Merging 1000 tables is usually a sign of a design problem. Can you
> > > explain why you need to merge that many tables???[/color]
> >
> >
> > Because I have so many points. (Simple description *g*)
> >
> > I have to deal with geographical points (x,y,z). They are stored in a
> > point table. For each point table I made a table with metainformation .
> > For an overwiev I want to join these metainformation .
> >
> > Sure, I can put all metainformation in one table. But I want to have
> > each measurement in a separat table.
> >
> > It has worked with about 1 Billion points from about 400 measurements.
> >
> > Now I have less points but more measurements. About 1000. And I tried
> > the same architecture.[/color]
>
> Well, have a look at :
> http://www.mysql.com/doc/en/MERGE.html
>
> Especially read the section on MERGE table disadvantages, it talks
> about file handles...
>
> I'd say try to change your design...[/color]

I think you are right. OK, another weekend work. *g*
Thanks.